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To  the  President  of  the  Senate  and  t^e 
Speaker  of  the  House  of  Representatives 

This  is  our  rep ext  efi  the  acquisition  of  ma^or  weapon  systems 
by  the  Department  of  Defense. 

Our  review  vts  cade  pursuant  to  the  Budget  and  Accountirg  Act, 
19?-1  (31  U.S.C.  53),  and  the  Accounting  and  Auditing  Act  of  1950 
(31  U.S.C.  67). 

Ton  will  receive  a  classified  suppleuent  containing  summaries 
of  our  evaluation  of  the  individual  veapea  systems  covered  by  cur 
study.  More  detailed  weapon  system  staff  studies,  sene  of  which 
are  classified,  have  been  prepared  and  distributed. 

Copies  of  this  report  are  being  sent  to  the  Director,  Office 
Management  and  Budget;  the  Secretary  of  Defense;  and  the  Secretaries 
of  the  Army,  Kavy.  and  Air  Force. 

Comptroller  General 
of  the  United  States 


.  " 
'■  A*’ 


w>  1 


CHAPTER 

£ass. 

System  schedule  experience 

45 

System  performance  experience 

47 

6 

SELECTED  ACQUISITION  REPORTING  SYSTEM 

48 

Results  of  current  review 

48 

Need  to  report  static  baselines 

Need  for  complete  and  realistic 

49 

cost  estimates 

Congressional  visibility  over  major 

50 

defense  acquisitions 

51 

Requirements  of  section  50b 

DOD's  compliance  with  section  506 

51 

51 

Observations 

52 

7 

GENERAL  OBSERVATIONS,  CONCLUSIONS,  AND 

RECOMMENDATIONS 

54 

Program  stability 

54 

Recommendations 

55 

Organisation,  staffing,  and  procedure- . 

56 

Recommendations 

57 

Cost  estimating  for  major  acouisitions 
Testing  and  evaluation  in  acHuisition 

58 

management 

58 

Recommendations 

59 

Cost-effectiveness  studies 

Performance  measurement  for  selected 

59 

acquisitions 

60 

System  cost  experience 

61 

Selected  acquisition  reporting  system 

62 

Recommendations 

62 

APFENDIX 

I 

Schedule  of  program  cost  data  as  of  June  30, 
1971,  arranged  by  acquisition  phase  and 

military  service 

63 

II 

Summary  of  major  acquisitions  of  the  De¬ 

partment  of  Defense  as  of  June  30,  1971 

65 

III 

Letter  dated  May  15,  1972,  from  the  Director 
of  Defense  Research  and  Engineering  com¬ 

menting  on  this  report 

66 

Contents 


Paftg 

DIGEST  1 

CHAPTER 

1  INTRODUCTION  5 

Development  process  for  a  major  weapon 

system  5 

Concepts  of  this  study  9 

2  PROGRAM  STABILITY  12 

Cutback  cf  the  DLGN  program  15 

Planned  use  of  the  AEGIS  fissile  system  17 
ARSV,  MICV,  and  BUSHMASTER  18 

3  ORGANIZATION,  STAFFING,  AND  PROCEDURES  20 

Authority  of  project  managers  23 

Effects  of  functional  organizations 

and  layering  on  project  management  25 

4  ASSESSMENT  OF  CRITICAL  MANAGEMENT  ACTIONS  28 

Cost  estimating  for  major  acquisitions  28 

Cost-effectiveness  studies  30 

Performance  measurement  for  selected 

acquisitions  32 

Adequacy  of  criteria  established  for 
program  performance  measurement  32 

Status  of  implementation  efforts  33 

Other  problem  areas  33 

Testing  and  evaluation  in  acquisition 

management  34 

5  SYSTEM  ACQUISITION  STATUS  36 

System  cost  e^erience  37 

Quantity  changes  40 

Engineering  changes  40 

Support  changes  41 

Schedule  changes  42 

Economic  changes  43 

Estimating  changes  43 

Sundry  changes  44 

Unidentified  changes  44 


ABBREVIATIONS 


ARSV 

AW  ACS 

CGN 

CNM 

CVAN 

DCA 

DLGN 

DOQ 

DODI 

GAO 

IOC 

mcv 

OSD 

PPBS 

SAR 


arrored  reconnaissance  vehicle 
Airborne  Warning  and  Control  System 
nuclear- povered  guided  missile  cruiser 
Chief  of  Naval  Material 
nuclear  aircraft  carrier 
Defense  Communication  Agency 
nuclear-povered  guided  missile  frigate 
Department  of  Defense 
Department  of  Defense  Instruction 
General  Accounting  Office 
initial  operational  capability 
mechanized  infantry  combat  vehicle 
Office  of  the  Secretary  of  Defense 
Planning,  Programing,  and  Budgeting  System 
selected  acquisition  report 


COMPTROLLER  GENERAL'. 

<  REPOST  TO  TS3  CSXGHEoS 


ACQUISITION  OK  f-AJOR  WEAPON  SYSTEMS 
Department  of  Defense  8-163058 


DIG  ESI 


;  VR'i  TEE  REVIEW  HAS  XiDE 

i 

!  The  investment  to  acquire  major  Department  of  Defense  (DOD)  weapons  contin- 
!  ues  to  make  a  heavy  impact  on  the  Nation's  resources.  Because  of  this  and 

|  the  belief  that  there  is  need  for  further  improvement  In  the  acquisition 

;  process,  the  General  Accounting  Office  (GAO)  has  again  appraised  those  fac- 

i  tors  most  closely  related  to  effective  performance  in  procuring  weapon  sys~ 

J  teas. 

i 

'  GAO  plans  to  continue  monitoring  the  acquisition  of  major  systems  by  DOD  and 
other  executive  agencies. 


PISOIEGS  AXD  CONCLUSIONS 


1,  GAO  has  given  recognition  to,  and  is  aware  of,  programs  that  have  been 
instituted  by  the  Office  of  the  Secretary  of  Defense  and  the  military  serv¬ 
ices  to  improve  management  of  the  acquisition  process.  GAO's  overall 
assessment  is  that,  since  last  year's  report,  meaningful,  measurable  prog¬ 
ress  has  been  made  in  improving  the  acquisition  process.  However,  certain 
troublesome  areas  remain  that  are  noteworthy. 

2.  Considerable  change  is  evident  in  weapon  system  development  programs. 

GAO  feels  this  is  traceable  to  the  early  requirements  planning  and  to  the 
instability  of  program  direction  caused  by  internal  as  well  as  external 
influences. 


There  is  a  question  as  to  whether.  In  the  conceptual  stage,  sufficient 
consideration  is  given  to  establishing  the  impact  of  one  weepor  system 
proposal  on  other  piograms,  on  the  total  force  structure  of  a  service  or 
D00,  or  on  the  possible  celling  on  dollar  resources.  Some  weapon  systems 
appear  to  have  been  conceived  and  justified  as  independent  systems. 

Once  initiated  programs  chanqe  because  of  the  increasing  cost  cf  the 
iteo  itself  or  because  of  the  need  to  make  funds  available  fc**  another 
program  for  which  resources  are  more  urgently  needed.  (See  ch.  2.) 

3.  Vteapor.  system  acquisition  problems  are  often  aggravated  by  the  cumber¬ 
some  organizational  structure. 

Decisions  related  to  systems  selected  for  program  management  appear  to 
be  based  primarily  on  total  expected  cost  rather  than  on  a  degree  of 
technical  risk,  a  need  for  aggressive  management  for  that  system,  or  the 
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desirability  of  grouping  equipments  into  systems  classed  as  major  acquisi¬ 
tions  because  of  system  interfaces  and  integration. 

There  were  important  differences  in  tiie  way  project  managers  were  orga¬ 
nized  and  operated.  The  mo«t  significant,  but  less  apparent,  difference 
was  the  extent  of  their  actual  authority  and  operating  decisionaaking 
powers. 

There  is  evidence  of  progress  in  improving  the  project  managers*  status 
and  training-further  progress  can  now  be  achieved  in  their  operating 
environments.  Although  it  is  impractical*  to  create  a  model  project  manager 
structure  that  will  fit  automatically  every  major  acquisition,  GAO  be¬ 
lieves  the  management  structure  for  each  acquisition  should  be  tailored 
to  that  particular  program.  (See  ch.  3.) 

4.  A  considerable  amount  of  the  cost  growth  in  the  acquisition  of  weapon 
systems  is  directly  attributed  to  unrealistic  ear.y  cost  estimates. 

(Sec  p.  28.) 

5.  Testing  and  evaluation  procedures  and  associated  t.-mtnology  vary  greatly 
among  the  services.  The  various  test  programs  contained  many  approved 
deviations,  substitutions,  waivers,  and  examples  of  special  circirastances. 
GAO  has  concluded  that  there  is  a  need  for  better  understanding  of  the 
basic  principles  and  for  better  application  of  testing  in  000.  (See  p. 

34.) 

6.  The  estimated  cost  of  77  weapon  systems  has  increased  by  about  $28.7  bil¬ 
lion  (31  percent).  This  increase  represents  the  difference  between  the 
original  estimates  and  the  current  estimates  of  total  program  cost. 

This  is  down  f-on  last  year’s  40-percent  increase  reported  on  61  systems 
and  can  be  attributed  primarily  to  the  addition  of  a  number  of  new  sys¬ 
tems  to  our  review,  which  reduces  the  program-planning  base  on  which  the 
percentage  computation  is  made.  The  otter  reason,  which  Is  os  ouch  more 
concern  to  GAO,  is  the  significant  number  of  quantity  decreases  on  many 
of  the  77  systems.  (See  p.  36.) 

For  the  46  systems  for  which  complete  cost  data  was  available  at  June  30, 
1971,  GAO  found  that  cost  changes  amounted  to  about  $30.8  billion.  Al¬ 
most  $12.2  billion  is  directly  related  to  changes  in  the  quantity  of 
units  to  be  purchased,  and  nearly  all  of  that,  or  $11.7  billion,  resulted 
from  decreased  units  to  be  bought.  (See  p,  37.) 

The  effect  of  that  kind  of  change  is  obvious— program  costs  go  down  and 
Individual  unit  costs  go  up.  Not  so  obvious,  but  perhaps  far  nore  signif¬ 
icant,  is  the  impact  of  these  quantity  reductions  on  Interrelated  weapon 
programs,  all  of  which  are  part  of  an  overall  plan.  (See  p.  61.) 
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KECOMEKDA  tlOVS  CP  EVGCESTICSS 


The  Secretary  of  Defense  should: 

1 .  Emphasize  (a)  a  continuing  rigorous  analysis  of  the  need  for  new  weapon 
systems,  Ct>)  a  careful  analysis  of  the  impact  of  proposed  needs  on  the 
manpower  and  dollar  resources  of  the  total  defense  force  as  well  as  the 
implication  tc  the  plans  for  the  usefulness  of  the  equipment  already  in 
inventory,  and  (c)  the  inclusion  throughout  of  a  properly  structured  proc¬ 
ess  which  makes  tradeoffs  between  various  ways  of  fulfilling  a  function, 
(See  p.  55.) 

2.  Reexamine  tne  weapon  systems  which  have  been  selected  for  project  manage¬ 
ment  and  which  have  teen  retained  under  project  management  and  spell 

out  specifically,  on  a  case-by-case  basis,  the  functions  that  a  project 
manager  trill,  and  will  not,  perform.  (See  p.  57.) 

3.  Develop  and  implement  DOD-wide  guidance  for  consistent  and  effective 
cost -estimating  procedures  and  practices,  particularly  (a)  an  adequate 
data  base  of  readily  retrievable  cost  data,  (b)  a  uniform  treatment  of 
inflation,  (c)  an  effective  independent  review  of  cost  estimates,  (d) 
more  complete  documentation  of  cost  estimates,  and  (e)  dependable  pro¬ 
gram  definitions.  (See  p.  58.) 

4.  Develop  and  implement  DOD-wide  guidance  to  provide  that  (a)  appropriate 
testing  and  evaluation  be  completed  prior  to  making  key  decisions  and 
(b)  adequate  controls  be  set  over  the  granting  cf  any  waivers  from  re¬ 
quired  testing  and  evaluation.  (See  p.  59.) 

5.  Reassess  the  criteria  for  designating  weapon  systems  for  selected  acquisi¬ 
tion  reporting  in  an  effort  to  expand  the  system.  (See  p.  62.) 


AGENCY  ACTIONS  AND  i'NRESOLVED  ISSUES 

DOD  has  stated  that  it  is  in  general  agreement  with  GAO’s  findings,  conclu¬ 
sions,  and  recommendations  and  that  It  has  taken  corrective  actions. 

(See  app.  III.) 


HATTERS  FOR  CONSIDERATION  BT  THE  CONGRESS 

This  repor;  provides  *he  Congress  with  an  independent  appraisal  of  the  com¬ 
plex  problems  associated  with  weapon  systems  development  and  procurement  by 
000--a  matter  of  serious  concern  in  the  Concress. 
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CHAPTER  1 


/ 

\  /  I HTPOPUCTT  oh 

The  investment  to  acquire  major  I^psrtnent  of  Defense 
(DOD)  weapons  a  heavy  impact  on  Mth  short-  atv>  long¬ 

term  allocations  of  the  Nation’s*  rtju Because  of  this 
impact  and  because  of  evidence  chat  tAw  .terpen  systems  ac¬ 
quisition  process  has  not,  in  son/  e.-isc » ,  been  conducted  ef¬ 
ficiently,  considerable  congressional  nud  public  attention 
has  been  focused  on  improving  the  prc:ess. 


This  interest  and  attention.  continued  during  the  past 
year.  The  authorizing  end  appropii3tions  committees,  as 
well  as  other  committees  of  the  C  ngrai  •,  continued  to  direct 
attention  to  major  acquisitions  and  g.ve  particular  emphasis 
to  major  problem  areas,  including  specific  weapon  system. 


The  Congress  has  called  upo'  thj  General  Accounting  Of¬ 
fice  (GAD)  to  report  periodically  on  ,.he  progress  of  various 
acquisition  programs  and  to  provide  its  committees  and  Dau¬ 
bers  with  more  reliable  irfo» nation  or.  which  to  base  judg¬ 
ments  concemirg  issues  involving  its  oversights  and  its  leg¬ 
islative  functions. 

To  effectively/^tespor.d  to  the  needs  of  the  Congress  '“AC 
established  a  long- tern  program  to  provide  up-to-date  ano 
comprehensive  data  on  major  weapon  systems.  This  report  is 
designed  to  provide  an  evaluation  of  the  effectiveness  of 
the  accuisition  orocess  and  substantive  factual  data  or.  cost, 
schedule,  and  periruticnce  of  the  individual  systems  being  de¬ 
veloped.  It  is  presented  in  a  format  consistent  with  that 
established  in  c%r  March  1971  report  end,  in  get  al,  deals 
with  management  actions  taken  since  June  30,  197c.  The  data 
presented  on  cost  and  changes  covers  the  period  from  June  30, 
1970,  to  June  30,  1971;  however,  the  most  recent  information 
available  has  been  used  as  much  as  possible  in  the  other  re¬ 
porting  areas. 


DEVELOPKENT  FTCCEES  FOR 
A  MAJOR  WEAPON  SYSTEM 

T».a  development  process  for  a  major  weapon  system  is 
highly  structured  and  complex,  involves  interaction  between 
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users  and  developers,  and  requires  a  substantial  part  of 
DOD’s  personnel  and  monetary  resources  and  a  large  segment 
of  the  Nation's  industrial  capacity.  It  Is  estimated  that 
it  will  cost  mote  than  bill ’on  to  acqxure  the  141 

weapon  systems  currently  under  development.  Some  ^93  billion 
of  "that  amount  is  yet  to  be  appropriated  by  the  Congress.  An 
oversimplified  representation  of  the  manner  in  which  weapon 
systems  evolve  from  an  idea  to  production  is  shown  in  fig¬ 
ure  I  on  the  following  page. 

Conceptual  phase-- This  is  the  initial  phase  in  the  ac¬ 
quisition.  of  a  weapon  system.  In  this  phase,  the  need  fot 
new  military  capability  is  established,  a  concept  which  will 
provide  this  capability  is  developed,  and  the  technical  fea¬ 
sibility  of  the  concept  is  explored  and  determined.  The  ob¬ 
jective  of  this  phase  is  to  identify  and  define  conceptual 
systems  on  the  basis  of  a  combination  of  analyses,  expei i- 
ments,  and  test  results.  Advancement  to  the  next  phase, 
validation,  is  dependent  upon  satisfying  criteria  designed 
to  measure  achievement  cf  the  conceptual  phase’s  objective. 

The  Secretary  of  Defense’s  approval  is  required  to  authorize 
the  program  to  move  into  the  validation  phase. 

Validation  phase— In  this  phase,  the  preliminary  designs 
and  engineering  for  the  weapon  system  are  verified  or  ac¬ 
complished,  management  plans  arc  made,  proposals  for  engi¬ 
neering  development  are  solicited  and  evaluated,  and  the  de¬ 
velopment  contractor  is  selected.  The  objective  of  this 
phase  is  to  verify  that  the  technical  and  economic  bases  for 
initiating  full-scale  development  of  the  weapon  system  are 
valid.  Advancement  to  the  next  phase,  full-scale  development, 
depends  upon  establisluaent  of  achievable  performance  speci¬ 
fications  for  the  weapon  system  that  are  supported  by  an  ac¬ 
ceptable  proposal  from  the  development  contractor  selected. 
The  Secretary  of  Defense’s  approval  is  required  for  the  pro¬ 
gram  to  move  into  the  development  phase. 

Full-scale  development-- tn  this  phase,  the  design  and 
engineering  of  the  weapon  system  is  accomplished.  The  devel¬ 
opment  contract  is  negotiated  and  awarded;  the  prototype  of 
the  weapon  svstera  is  developed,  produced,  and  tested;  and  the 
detailed  specifications  for  manufacturing  the  weapon  system 
ate  prepared.  The  objective  of  this  phase  is  to  develop  a 
weapon  system  acceptable  for  production.  Advancement  to  the 
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Figure  I 


production  phase  must  be  authorized  by  the  Secretary  of  De¬ 
fense, 

The  development  phase  overlaps  the  production  phase 
since  development  is  not  considered  complete  until  adequacy 
of  the  production  model  of  the  veapon  system  has  been  vali¬ 
dated  by  a  series  of  production  acceptance  tests. 

Production — In  this  phase,  the  weapon  system  i1?  produced 
in  quantity  for  deployment.  It  begins  when  the  pi  eduction 
contract  is  negotiated  and  awarded.  Production  acceptance 
tests  are  conducted  to  validate  the  adequacy  of  the  produc¬ 
tion  model  of  the  veapon  systc  s.  Quantity  production  is 
initiated,  and  the  first  operational  unit  is  equipped  with 
the  weapon  system  and  is  trained  in  its  use.  Advancement  to 
the  operational  phase  occurs  when  the  first  operational  unit 
equipped  with  the  weapon  .system  is  deployed.  However,  pro¬ 
duction  continues  until  all  required  quantities  of  the  weapon 
system  are  produced.  The  production  phase  includes  tests  of 
production,  service,  and  user  acceptance. 

Many  potential  weapon  systems  never  progress  beyond  tne 
early  stages  of  consideration,  e.g.,  the  conceptual  phase. 
There  are  many  reasons  for  this:  unavailability  of  neces¬ 
sary  technology;  realization  that  a  potential  system  may  be¬ 
come  too  costly  for  its  intended  purpose;  anticipated  obso¬ 
lescence  in  terms  if  threat  that  the  system  is  intended  to 
counter;  or  subsequently,  more  effective  competition  ty 
another  system  concept.  As  a  system  passes  through  valida¬ 
tion,  the  Government’s  commitment  to  It  becomes  firmer.  By 
the  time  the  system  reaches  full-scale  development,  the  Gov¬ 
ernment's  commitment  has  become  so  great,  and  the  structure 
of  the  program  so  definite,  that  major  adjustments  to  the 
program  are  difficult  because  they  almost  always  delay  crit¬ 
ical  delivery  dates  and  are  costly.  Few  really  acceptable 
options  are  available  to  the  Government  once  the  design  has 
been  approved  and  a  decision  has  been  made  to  begin  produc¬ 
tion. 

The  pattern  of  deeper  involvement  and  decreasing  op¬ 
tions  is  shown  in  the  following  chart.  (See  fig.  II.)  The 
greatest  opportunity  for  broad  decisions  occurs  during  the 
early  stages  of  acquisition. 


CONCEPTS  OF  THIS  STUDY 


Tc  was  clear  to  GAO  that  the  underlying  management  dif¬ 
ficulties  and  tin  problems  of  taking  sound  day-to-day  actions 
at  all  levels  were  deep  seated  and  could  best  be  evaluated 
by  a  systematic  review  of  the  entire  process  by  using  spe¬ 
cific  systems  and  phases  as  a  basis  tor  case  studies. 

At  the  outset  critical  major  weapon  acquisition  manage¬ 
ment  actions  and  decisions,  which  would  occur  in  every  ac¬ 
quisition,  were  outlined.  In  determining  these  critical 
actions,  DOD's  own  criteria  and  objectives  were  used.  The 
critical  management  activities  examined  pertained  to 

— requirements  for  systems, 

— assessment  of  technical  progress,  and 

—organization  and  procedures. 

Several  factors  influenced  our  selection  of  specific 
weapon  systems.  First,  we  selected  some  of  the  systems  for 
which  the  Congress  or  DOD  would  have  future  options  regarding 
further  courses  of  action.  Second,  we  selected  a  number  of 
weapon  systems  which  recently  proceeded  into  the  early  phase 
of  the  acquisition  process.  This  factor  is  most  important 
because  problems  occurring  in  the  earlier  phases  may  plague 
the  system  for  years  and  may  adversely  affect  the  cost, 
schedule,  and  performance  of  the  system  at  a  point  when  ad¬ 
justments  are  difficult  to  make.  As  was  noted  earlier,  it 
is  also  the  point  in  time  when  the  greatest  number  of  options 
are  available  to  both  DOD  and  the  Congress.  Although  little 
is  to  be  gained  by  dwelling  on  problems  which  have  occurred 
in  weapon  systems  vhere  options  are  low,  we  have  included  a 
few  such  systems  in  our  study  since  they  provide  the  best 
means  of  assessing  the  full  import  of  sound  and  unsound  past 
actions. 

To  fulfill  our  task  we  reviewed  38  systems  Cll  Air  Force, 
11  Navy,  and  16  Army).  Ve  reviewed  also  cost  and  schedule 
data  from  a  number  of  other  systems.  Still  other  systems 
were  reviewed  at  the  request  of  congressional  committees. 

In  all,  the  data  in  this  report  are  distilled  from  studies  of 
some  aspect  of  78  weapon  systems.  Ve  appraised  these  systems 


in  terms  of  vhat  happened  to  them  in  the  last  year  and  at¬ 
tempted  to  evaluate  the  overall  acquisition  process  in  re¬ 
lation  to  the  baseline  established  in  our  first  report.  We 
also  examined  some  of  the  more  critical  problem  areas  in 
greater  depth. 

In  chapter  2  the  instability  of  acquisition  programs  is 
discussed.  Chapter  3  contains  details  of  our  observations 
on  project  management  organizations,  staffing,  and  procedures. 
In  chapter  4  several  of  the  management  actions  critical  to 
weapon  system  acquisition  are  described  in  some  detail. 
Chapters  5  and  6  are  concerned  with  system  acquisition  status 
and  the  selected  acquisition  reporting  system.  Chapter  7 
contains  our  specific  recommendations. 

Scope 

To  review  current  policies  and  practices,  we  examined 
weapon  systems  in  various  phases  of  acquisition — conception, 
validation,  full-scale  development,  or  production. 

Information  on  these  programs  was  obtained  by  reviewing 
\  Ians,  reports,  correspondence,  and  other  records  and  by 
interviewing  officials  at  the  system  program  office,  inter¬ 
mediate  and  higher  commands  tiuroughout  the  military  depart¬ 
ments,  and  the  Office  of  the  Secretary  of  Defense  (OSD),  We 
evaluated  management  policies  and  the  procedures  and  controls 
related  to  the  decisionmaking  process,  but  we  did  not  make  any 
detailed  analyses  or  audits  of  the  basic  data  supporting 
program  documents.  We  made  no  attempts  to  (1)  assess  the 
military  threat  or  the  technology,  (2)  develop  technological 
approaches,  or  (3)  involve  ourselves  in  decisions  while  they 
were  being  made. 
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CHAPTER  2 


PROGRAM  STABILITY 

In  our  March  1971  report  to  the  Congress,  we  pointed 
out  that  to  effeitively  pursue  program  objectives  required 
stable  priorities  and  consistent  program  direction-  We  ex¬ 
pressed  the  belief  that  the  development  of  a  comprehensive 
OOD-wide  priority  system  was  a  first  step  toward  incorporat¬ 
ing  stability  into  programs.  Accordingly,  we  recommended 
that  the  Secretary  of  Defense  make  every  effort  to  develop 
and  perfect  the  DOr-wide  method — then  in  its  early  stages  of 
development.  The  method  was  designed  to  be  followed  by  all 
military  services  for  determining  two  things:  first,  what 
weapon  systems  were  needed  in  relation  to  the  DOD  missions 
and  second,  what  the  priority  of  each  should  be  in  relation 
to  other  systems  and  their  missions. 

In  the  fall  of  1971,  DOD  announced  its  new  system  for 
a.  revised  Defense  Planning,  Programming,  and  Budgeting  Sys¬ 
tem  (PPBS).  This  new  system  furnishes  fiscal  and  logistical 
guidance  for  a  5- year  period  and  provides  for  attaining  re¬ 
quired  support  levels  by  the  end  of  that  period. 

The  revised  PPBS  centers  around  five  major  changes. 

--The  system  is  designed  to  accept  National  Security 
Council  input  at  key  points. 

— Ec anemic  realism  is  Introduced  at  the  earliest  feasi¬ 
ble  stage  through  the  fiscal  guidance.  Everyone  in 
the  process  is  forced  to  think  about  priorities 
throughout  the  cycle,  Instead  of  just  a  few  people  at 
the  end  of  the  cycle. 

— The  Joint  Chiefs  of  Staff  are  involved  for  a  longer 
period  of  time,  and  their  views  on  forces,  priori¬ 
ties,  and  risks,  as  expressed  in  the  Joint  Force  Mem- 
orandva,  have  a  key  role  in  the  development  of  the 
5-year  defense  program. 

— The  responsibility  for  analytical  input  has  been 
shifted  to  the  services. 
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— The  cycle  is  extended  by  about  4  months  and  provides 
an  opportunity  for  a  trore  active  dialogue  among  the 
services,  the  Joint  Chiefs  of  Staff,  and  OSD  to  get 
the  full  benefit  of  the  best  thinking  in  DQD.  There 
is  time  for  differences  of  opinior,  but  there  Is  more 
time  tc  reach  agreement. 

Although  it  may  be  too  early  for  the  influences  of  this 
revised  system  to  be  felt,  the  frequency  and  extent  of 
changes  in  development  programs  suggest  th*t  the  system  is 
not  yet  accomplishing  its  stated  objectives. 

We  revieved  changes  in  61  programs  on  which  ve  had  com¬ 
plete  data.  Many  of  these  changes  related  to  hardwire  and 
were  not  consistent  with  original  statements  of  need  or  with 
earlier  indications  of  the  important  relationship  between 
one  subsystem  and  another. 

Between  June  30,  1970,  and  June  30,  1971,  there  we3  a 
net  decrease  of  $4.2  billion  (from  $117  billion  to 
$112.8  billion)  in  total  estimated  program  costs  for  these 
61  major  systems.  In  all,  quantity,  engineering,  economic, 
schedule,  and  other  changes  increased  or  decreased  programs 
by  $29.2  billion.  By  any  measure  cost  fluctuations  amount¬ 
ing  to  nearly  25  percent  of  the  total  estimated  program 
costs  indicate  a  major  problem. 

All  programs  are  reviewed  periodically,  and  a  degree  of 
modification  is  to  be  expected.  As  a  rough  generality,  per¬ 
formance  requirements  for  strategic  programs  undergo  less 
frequent  modification  than  do  tactical  programs.  One  of  the 
principal  reasons  for  the  fluctuations  in  tactical  weapon 
systems  programs  seems  to  be  the  changes  in  mission  concepts 
during  the  development  phase  end  their  relationship  to  other 
programs,  either  in  inventory  or  under  development.  In¬ 
stances  of  substantial  changes  in  the  performance  require¬ 
ments  for  individual  systems  being  acquired  are  commonplace. 
Some  examples  are  the  F-14,  LANCE,  LAMPS,  F-lll,  SAM-D,  HAWK, 
and  AEGIS. 

Examination  of  a  number  of  programs  provides  clear  il¬ 
lustrations  of  the  penalties  attendant  to  planning  and  pro¬ 
graming  where  such  management  methods  as  those  we  recommended 
last  year  are  lacking.  To  assist  the  Secretary  in 
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accelerating  the  implementation  of  an  improved  management 
method,  ve  reviewed  the  histories  of  several  programs  which, 
in  our  opinion,  were  not  examined,  planned,  or  managed,  with 
full  consideration  of  related  programs  end  weapon  systems. 
There  is  a  question  whether,  in  the  conceptual  stage,  an  at¬ 
tempt  vus  made  to  establish  the  impact  of  a  weapon  proposal 
on  other  programs,  on  the  total  force  structure  of  a  service, 
or  on  the  possible  ceiling  of  dollar  resources. 

The  change  took  place  in  and  among  these  major  systems 
during  the  last  year  and  is  illustrated  in  the  following  dis¬ 
cussions. 


CUTBACK  C  THE  DIGS  FROGRAM 


The  requirement  for  nuclear- powered  guided  missile 
frigates  (DLGNs)  is  closely  related  to  uie  Navy's  program 
for  acquisition  of  nuclear  aircraft  carriers  (CVANs).  The 
Navy's  stated  program  is  to  provide  four  DLGNs  for  each 
nuclear  carrier,  although  according  to  Navy  officials,  a 
nuclear-powered  guided  missile  cruiser  (CGN)  may  be  sub¬ 
stituted  for  a  DIGN  /.t  June  30,  1970,  the  Navy  had  one 
nuclear  carrier  in  operation  and  two  additional  carriers 
under  construction.  At  that  date  the  Navy  program  antici¬ 
pated  obtaining  three  additional  nuclear  carriers. 

At  the  same  date  the  Navy  had  two  DLGNs  and  roe  CGN  in 
operation.  Two  additional  DDCNs  were  under  construction. 

To  provide  for  a  six-carrier  program,  the  Navy  needed  19  ad¬ 
ditional  DLGNs.  This  quantity  was  increased  by  an  additional 
four  ships  required  for  reserve  and  other  purposes,  making 
a  total  of  23  necersary. 

Early  in  1971  the  DLGH  project  office  was  instructed 
to  reduce  the  number  of  DLGNs  from  23  to  six,  the  Navy  posi¬ 
tion  being  that  this  quantity  would  satisfy  the  escort  re¬ 
quirements  for  the  three  nuclear  carriers  then  in  use  or 
under  construction.  A  few  months  later  the  requirement  was 
further  reduced  from  six  to  three. 

This  same  information  follows  in  tabular  form. 

"LGNs  needed 
for  the 

CYAN  -program  CYAN  program 

In  operation  1  4 

Under  construction  2  8 

Anticipated  3  12 

Reserve  -  _4 

k  m 


is 


In  operation 
Under  construction 
Planned 


6-30-70 

3 

2 

23 

28 


DLGN  program 


March  1971 

3 
2 
_j6 

11 


6-30-71 

3 

2 

3 
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The  rationale  fcr  these  changes  was  explained  in  two 
letters  from  the  Deputy  Secretary  of  Defense  to  the  Chair¬ 
man,  Joint  Committee  on  Atomic  Energy,  as  follows:  (1)  the 
substantial  overall  cost  of  the  DLGNs  (about  $250  million 
for  each  ship) ,  (2)  other  high-priority  needs  of  DOD,  (3) 
limitations  on  funds  available  for  defense,  and  (4)  the  de¬ 
sire  to  incorporate  new  weapon  systems  on  the  DLGN,  such  as 
the  AEGIS  missile  system  currently  under  development. 

Ihere  are  several  interesting  aspects  of  the  reduction 
in  quantity  of  DLGN- 38s.  The  decision) to  reduce  the  number 
of  ships  to  be  procured  was  based,  in  part,  on  the  desire 
to  incorporate  new  systems,  such  as  the  AEGIS.  However, 
the  Navy's  ship  acquisition  plan  stated  that  the  AEGIS  would 
not  be  ready  in  time  to  install  it  on  early  ships  of  the 
DLGN- 38  class.  Navy  officials  stated  that  AEGIS  could  be 
installed  on  DLGN- 38s  after  they  were  completed,  but  OSD 
said  that  this  would  require  a  major  overhaul,  would  be 
costly,  and  would  tie  up  the  ship  for  about  a  year. 

The  reduction  in  quantities  of  the  DLGN- 38  from  23  to 
three  illustrates  the  problem  we  see  in  the  present  Defense 
planning.  The  rationale  given  by  the  Deputy  Secretary  is 
the  kind  of  rationale  that  cculd  be  applied  to  almost  any 
program.  All  weapon  systems  are  expensive,  and  costs  are 
increasing  rapidly.  There  are  always  other  high-priority 
needs;  even  in  the  best  years  funds  have  been  limited, and 
new  weapon  systems  must  always  be  incorporated. 

Obviously  the  23  DLGN- 38s  were  at  one  time  a  high- 
priority  need.  What  occurred  to  reduce  this  need  so  substan¬ 
tially  in  terms  of  overall  Defense  needs  is  certainly  not 
clear.  We  think  that  the  real  question  is  how  this  substan¬ 
tial  reduction  equates  with  what  the  Navy  thought  its  high- 
priority  needs  were  4-1/2  years  ago,  what  they  think  they 
are  now,  and  what  really  has  changed  in  the  way  DOD  planned 
to  accomplish  its  mission. 
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PLANNED  USE  OF  THE  AEGIS  MISSILE  SYSTEM 


AEGIS,  an  expensive,  advanced  surface  missile  system, 
will  not  go  on  the  DLGN-38,  the  ship  for  which  it  was 
originally  intended.  Unless  a  new  class  and/or  classes  of 
ships  are  authorized  for  construction,  the  alternatives 
for  designation  of  a  ship  for  AEGIS  will  involve  modifi¬ 
cations  to  the  AEGIS  system:  design  changes  to  ships  under 
construction;  or  retrofitting  ships  that  are,  or  will  be, 
in  the  fleet. 

A  modified  version  of  AEGIS  suitable  for  installation 
in  the  DD-963  class  destroyers  would  require  changes  in  the 
ships*  design.  However,  the  contract  for  construction  of 
the  DD-963s  was  structured  to  minimize  configuration  changes 
to  the  ship  and  to  maximize  the  contractors'  responsibility 
for  the  characteristics  of  the  ship.  This  alternative 
becomes  even  less  attractive  in  view  of  the  DD-963* s  ship¬ 
building  schedule  which  currently  indicates  that  most  of 
the  destroyers  will  have  been  completed  by  the  time  AEGIS 
is  scheduled  to  be  available. 

There  are  many  alternatives,  such  as  retrofitting 
either  the  DD-963s  which  will  be  completed  before  AEGIS 
is  available  or  the  glided  missile  frigates  in  the  fleet. 

The  Navy  has  determined  that  it  is  feasible  to  retrofit 
AEGIS,  but  retrofit  costs  have  not  yet  been  determined. 
Generally,  the  Navy  considers  retrofitting  as  an  unfavor¬ 
able  alternative  because  of  its  high  cost. 

Other  possible  alternatives  include  retrofitting 
carriers  and  the  TARTAR- equipped  frigates  being  constructed 
or  using  AEGIS  on  patrol  frigates.  The  patrol  frigates  are 
still  in' the  planning  stage,  and  a  much  smaller  version  of 
AEGIS  would  have  to  be  developed  for  use  in  these  planned 
ships. 

The  designation  of  a  need  an d  ships  for  the  AEGIS  has 
alternately  changed  from  the  initially  intended  DLGN-38 
(10,000  tons)  to  a  possibility  of  DD~963s  or  DLGs  (7,600  tons 
and  5,900  to  8,400  tons,  respectively)  and  now  to  a  new  class 
of  missile  escort  ships  (probably  on  the  order  of  5,000  to 
6,000  tons). 


Because  the  ultimate  plat fora  for  AEGIS  is  getting 
smaller  and  smaller,  AET-IS  must  be  scaled  down  accordingly. 
The  Navy  recently  stated  that  the  performance  objectives  of 
a  scaled-down  system  were  the  same  as  those  of  the  larger 
system  except  for  reduced  target-handling  capacity. 

ARSV,  MICV.  AND  BUSHM ASTER 


The  Army  considers  the  capabilities  of  the  armored 
reconnaissance  vehicle  (ARSV)  and  the  mechanized  infantry 
combat  vehicle  (MICV)  to  be  closely  related;  they  are 
considered  to  be  companion  weapon  systems.  The  BU5KKASTE3 
weapon  system  is  designated  as  the  primary  armament  for 
these  vehicles.  All  three  systems  are  urgently  required 
to  meet  a  tnreat  that  could  not  be  met  with  existing  equip¬ 
ment,  yet  the  histories  of  these  systems  do  not  reflect  the 
stated  urgency  of  the  requirement. 

The  project  managers  have  considered  these  systems  to 
be  ready  for  the  next  phase  of  the  acquisition  process  for 
quite  some  time,  but  progress  of  these  programs  has  been 
delayed  substantially.  BUSKMASXER ,  MICV,  and  ARSV  do  not 
represent  any  great  advancement  in  technology,  but  they 
have  spent  10,  7,  and  5  years,  respectively,  in  the  concept 
formulation  phase.  The  deployment  dates  have  slipped  13, 

3,  and  7  years,  respectively.  Of  the  funds  that  have  been 
appropriated  for  BUSHMASTER  end  MICV,  a  large  proportion 
has  been  reprogramed  for  use  on  other  programs  by  either 
the  Army  or  OSD.  The  Army,  early  in  1971,  made  the  decision 
to  enter  the  development  phase  of  all  three  systems  at  the 
earliest  feasible  date. 

Since  1967  the  planned  procurement  of  BUSHMASTER  has 
dropped  94  percent.  The  procurement  objectives  for  ARSV 
and  MICV  have  been  reduced  substantially  also.  Current 
procurement  plans  Include  only  enough  BUSHMASTERS  to  equip 
the  Immediate  needs  of  MICV.  The  gun  system  that  has  been 
designated  to  serve  as  an  interim  weapon  for  ARSV  does  not 
have  the  capability  required  by  the  Army  at  extended  ranges. 
In  addition,  that  gun  is  currently  being  retrofitted  onto 
another  vehicle  and  will  have  to  be  removed  before  it  Is  put 
on  ARSV.  The  Army  3till  believes  BBSSMASTES  is  the  best 
weapon  for  ARSV,  as  well  as  for  MICV.  Under  present  funding 
constraints  the  Army  is  now  planning  to  retrofit  ML39  guns 


for  ARSV  because  this  approach  would  provide  a  marginally 
satisfactory  interim  capability.  However,  the  Army  still 
hopes  to  acquire  funds  in  the  future  to  equip  both  vehicles 
with  EUSHMASTER.  In  addition  to  providing  these  vehicles, 
with  the  most  desirable  gun  system  capability,  the  increased 
procurement  would  produce  an  added  benefit  of  lowering  the 
unit  cost. 

These  three  programs  were  initiated  in  about  the  same 
time  frame  and  ostensibly  were  part  of  the  Army's  overall 
plan  for  satisfaction  of  combat  vehicle  requirements.  Thev 
have  been  studied,  reviewed,  evaluated,  redirected,  and 
sustained  throughout  by  nominal  level:;  of  funding. 

Delays  in  MICV  have  been  attributed  to  its  relatively 
low  priority,  funding  constraints,  changes  in  management 
processes,  and  management  reviews.  Throughout  the  course 
of  the  ARSV  program,  -any  slippages  occurred  due  to  such 
factors  as  procurement  method  changes;  delays  in  the  con¬ 
current  acquisition  of  the  BUSHMASTER  gun;  and  the  time 
needed  to  (1)  reaffirm  the  ARSV  program  as  the  means  of 
satisfying  the  requirements,  (2)  conform  the  program  to 
changes  in  the  acquisition  process,  and  (S',  prepare,  revise, 
and  coordinate  the  development  concept  paper,  the  management 
document  used  a  basis  for  the  decision  to  advance  to 
another  pha3e.  Also  causing  schedule  slippage  was  evaluating 
the  program  to  consider  alt- .native  versions  ana  proposals 
in  response  to  funding  constraints  resulting  from  the  low 
priority  of  ARSV  in  relation  to  other  Aroy  programs.  The 
long  delay  in  the  BUSHMASTER  program  has  been  caused  pri¬ 
marily  by  the  delays  in  the  MICV  and  ARSV  programs  noted 
above,  deletion  of  U.5.  Marine  Corps  and  main  battle  tank 
requirements,  and  increased  fiscal  constraints. 


CHAPTER  3 


ORGANIZATION,  STAFFING.  AND  PROCEDURES 

Last  year  v«  reported  on  some  of  the  problems  in  orga¬ 
nizing  for  weapon  system  management.  Including  the  differing 
practices  followad  In  each  of  the  services.  We  contrasted 
project  manager  organizations  that  are  essentially  self- 
supporting  Ca  method  used  mainly  by  the  Air  Force  and  other 
services  for  such  super  programs  as  POSEIDON  and  SAFEGUARD) 
with  those  providing  relatively  little  direct  support  to  the 
project  manager  but  relying  heavily  on  functional  organiza¬ 
tions  for  support  f employed  mainly  by  the  Army  and  Navy). 

The  report  also  discussed  the  problems  of  layering  in  each 
of  the  services. 

During  the  past  year  we  have  made  further  studies  of 
the  organization  for  project  management  in  DGD,  including 
the  differing  organizations  in  each  service,  a  more  detailed 
analysis  of  the  layering  problem,  and  the  effects  of  func¬ 
tional  organizations.  We  were  seeking  answers  to  the  fol¬ 
lowing  three  questions, 

1.  How  much  control  does  the  project  manager  really 
have  over  weapon  system  design,  design  changes,  and 
system  Interfaces? 

2.  How  much  control  does  the  project  manager  really 
have  over  program  resources —  funds ,  people,  and  fa¬ 
cilities? 

3.  How  much  control  does  the  project  manager  really 
have  over  the  contract or (s)? 

The  answers  to  these  three  questions  varied  widely 
among  and  within  the  services.  A  greater  degree  of  control 
appeared  to  be  present  in  some  Air  Force  programs,  and  the 
least  control  was  evident  in  Navy  programs}  the  Army  pro¬ 
grams  were  generally  somewhere  in  between. 

He  used  program  work  breakdown  structures  which  contain 
all  the  tasks  requring  accomplishment  to  meet  the  program 
objectives.  These  structures  are  supposed  to  facilitate  a 
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core  effective  management  and  technical  bass  for  planning 
and  assigning  management  and  technical  responsibilities  by 
operations  within  those  governmental  offices  responsible  for 
acquisition  of  defense  items  and  those  contractors  furnish¬ 
ing  the  items. 

The  Airborne  Warning  and  Control  System  (AWACS),  headed 
by  a  general  officer,  is  a  fairly  typical  Air  Force  project. 
Hie  project  manager  has  a  staff  of  106  people.  Under  Air 
Force  policy  he  was  permitted  to  select  technical  personnel 
who  were  well  grounded  in  the  various  kinds  of  subsystems 
involved  in  his  project,  to  give  himself  some  fairly  sub¬ 
stantial  competence  in  making  independent  technical  apprais¬ 
als  and  cost,  schedule,  and  performance  changes  both  in  the 
initial  design  and  in  the  day-to-day  management  of  his  proj¬ 
ect. 


An  examination  of  the  work  breakdown  structure  shows 
that  all  the  hardware  development  is  the  direct  i jsponsi- 
biiity  of  the  project  manager.  Ke  is  responsible  for  all 
hardware  items,  such  as  navigation  and  air  vehicle  subsys¬ 
tems  and  cccounication,  radar,  beacon,  and  data  processing 
equipment.  The  only  technical  task  in  his  project  over 
which  he  does  not  have  direct  control  is  early  component 
testing.  Several  testing  organisations  are  involved,  with 
which  the  project  manager  must  agree  on  schedules  and  pro¬ 
grams.  Most  of  these  agreements  are  written  and  arc  fairly 
specific  as  to  aircrrft  required,  when  they  ere  required, 
end  the  responsibilities  of  the  parties  involved. 

The  XM-803  (formerly  MBT-70)  and  the  M-60,  both  tank 
programs ,  are  reasonably  typical  Army  projects.  The  XM-803 
is  managed  by  a  senior  civilian  who  reports  directly  to  the 
Commanding  General,  Army  Material  Command,  and  the  M-60  is 
managed  by  e  military  of  ficer  of  lesser  rank  who  report*  to 
the  Commanding  General,  Weapons  Command,  a  layer  lover  in 
the  organization. 

In  both  cases  the  project  managers  rely  more  on  other 
Amy  organizations  for  technical  expertise  than  does  the 
AWACS  project  manager.  As  many  as  seven  major  Artsy  commands 
(each  with  its  own  missions,  such  as  weapons,  missives,  mu¬ 
nitions,  etc.)  may  be  involved  in  the  development  and  pro¬ 
duction  of  a  tank. 


?1 


Reliance  by  the  project  manager  on  organisations  vhose 
basic  mission  is  different  from  his  own  for  knowledge  as  to 
what  is  available  for  him  to  use,  with  no  real  way  to  ap¬ 
praise  the  alternatives,  places  him  in  a  difficult  position. 
Even  when  the  project  manager  has  knowledge  of  what  appear 
to  be  acceptable  alternatives  to  those  offered  by  the  func¬ 
tional  experts,  the  sluggishness  of  decisions  th"ough  the 
various  organizations  slows  the  whole  acquisition  process. 

Probably  the  most  complicated  structure  of  all  involves 
Navy  ships.  There  are  two  reasons  for  this:  (1)  the.  Navy 
believes  strongly  in  austere  project  management  organizations 
and  in  heavy  reliance  on  functional  organizations  and  (2)  a 
ship  is  essentially  only  a  platform  containing  a  very  large 
amount  of  equipment  developed  by  others.  Much  of  the  com¬ 
ponentry  is  of  such  magnitude  as  to  be  individually  managed 
and  has  complications  in  its  own  right. 

The  SSN-688  mclear  attack  submarine  program  is  typi¬ 
cal  of  the  complications  in  a  ship  program.  It  is  directed 
and  controlled  by  two  project  officers.  Ctie — staffed  by 
seven  people— reports  to  the  Chief  of  Naval  Material  (CNM) 
and  is  responsible  for  broad  planning  and  direction,  and  a 
second — staffed  by  55  people— is  responsible  for  the  acqui¬ 
sition  of  the  ship  and  reports  to  the  Ship  Systems  Command, 
a  suborganization  of  CNM.  The  program  involves  37  subma¬ 
rines  estimated  to  cost  $6.8  billion  over  a  5-year  period. 

In  all,  the  project  manager  interfaces  with  23  organi¬ 
zations  responsible  for  the  211  pieces  of  equipment  making 
up  the  15  subsystems  on  the  submarine.  In  these  organiza¬ 
tions  the  project  manager  works  through  secondary  managers 
who  do  not  work  directly  for  him  but  with  whom  he  has  gen¬ 
eralized  written  agreements.  Seven  of  these  secondary  man¬ 
agers  are  project  managers  who  have  their  own  functional 
Interface  problems . 

There  is  not  enough  evidence  to  date  to  make  a  strong 
case  for  one  particular  type  of  program  management  organi¬ 
zation's  being  clearly  superior  to  another.  There  have  been 
program  successes  and  failures  both  with  the  centralized, 
self-sufficient,  relatively  large  program  offices  and  with 
the  smaller  program  offices  that  utilize  the  service  func¬ 
tional  areas  for  major  support.  GAO  will  continue  to  eval¬ 
uate  program  management  to  determine,  from  a  lea sons- learned 
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standpoint,  the  preferred  concepts  for  various  types  or  pro¬ 
grams  . 

AUTHORITY  0/  PROJECT  MANAGERS 

With  some  exceptions  the  military  services  have  not 
placed  the  project  manager  high  in  the  organizational  struc¬ 
ture  because  of  such  practical  considerations  as  the  large 
number  of  project  managers  and  the  need  for  them  to  work 
directly  at  lower  levels  of  the  organization.  The  effect 
has  been  to  create  levels  of  review  authority  contributing 
little  to  the  process  of  formulating  decisions. 

A  project  manager  is  normally  a  colonel  or  Navy  captain, 
and  his  place  in  the  organization  is  four  or  five  levels  be¬ 
low  the  service  secretary  and  military  chief.  He  is  fre¬ 
quently  outranked  in  the  functional  and  staff  organizations 
with  which  he  must  deal. 

In  addition  to  the  chain-of- command  layering,  many  of 
the  functions,  such  as  the  budget  and  contracting  function, 
are  themselves  layered  so  that  approval  for  action  in  these 
functional  areas  must  also  clear  through  these  organiza¬ 
tional  layers. 

Project  managers  operate  under  charters  that  tend  to 
be  written  very  generally,  and  most  charters  could  be  ap¬ 
plied  to  almost  any  project.  A  project  manager's  charter  ir» 
the  Army,  for  Instance,  could  be  applied  to  most  Navy  pro¬ 
jects  with  only  minor  changes  in  wording.  (There  are  ■  >mc 
exceptions;  for  example,  the  F-15  tends  to  be  more  s>  tic 
about  what  the  project  manager  can  and  cannot  do.)  Nccc 
charters  state  that  the  project  manager  has  broad  authority 
and  responsibility. 

In  actual  practice  the  charters  provide  the  project 
manager  with  little  authority  because  of  a  very  large  body 
of  rules  that  project  managers  are  required  to  follow. 

These  rules  involve  many  diverse  activities,  such  as  fund 
and  configuration  management;  cost,  schedule,  and  control; 
safety;  logistics;  development  of  work  breakdown  structure 
and  management  information  systems;  reliability;  maintain¬ 
ability;  cost  reduction;  value  engineering,  etc.  Since  the 
rules  are  written  for  everybody,  they  fit  almost  nobody. 
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When  the  project  manager  relies  on  support  from  other 
technical  managers,  he  usually  operates  by  means  of  vritter. 
agreements.  The  use  of  letter  agreements  between  project 
managers  and  the  functional  organization  adds  little  in  the 
way  of  real  control  to  the  project  managers'  operation, 
except  in  those  cases  where  the  agreements  are  specific. 

The  agreements  are  generally  very  vague  and  say  little  more 
than  "we  will  help  each  other."  The  agreements  usually  do 
not  specify  such  things  as  who  makes  the- final  decisions, 
what  kind  of  control  the  project  manager  exercises  over  the 
development,  or  the  mechanisms  available  to  him  to  know  that 
what  is  being  developed  is  best  for  his  project. 


EFFECTS  OF  FUNCTIONAL  ORGANIZATIONS  AND 
7AYERING  ON  PROJECT  MANA.GF.MENT 

Discussed  below  are  several  illustrative  examples  of 
the  kinds  of  problems  the  system  creates  for  project  managers. 
Literally  thousands  of  such  examples  could  be  given  because 
they  are  typical  of  the  way  things  are  done  and  decisions  arc 
made.  Most  of  the  examples  are  oversimplified,  since  in 
tracing  a  transaction  through  the  system,  it  is  almost  im¬ 
possible  to  identify  all  the  people  or  even  the  organizations 
involved. 

1.  The  project  office  for  the  MARK  48  torpedo  initiated 
a  procurement  request  and  associated  documents  for  modifica¬ 
tion  kits  for  the  submarine  fire  control  system  estimated  to 
cost  $5  million.  Without  the  kits  the  effectiveness  of  the 
torpedo  is  impaired.  The  request  was  therefore  considered 
urgent,  aid  to  expedite  matters  a  letter  contract  was  to  be 
awarded. 

After  preparation,  the  request  was  sent  through  the 
MARK  48  project  office  for  approval  and  a  copy  went  to  the 
Naval  Ordnance  Systems  Command  for  processing.  The  command 
processed  it  through  the  Contract  Office  Planner,  Logistics 
Support,  for  a  priority  rating;  through  administration  for  a 
security  classification;  through  Plans,  Programs,  and  Finan¬ 
cial  Management  for  a  check  on  fund  availability;  and  through 
the  Systems  and  Acquisition  Directorate  for  review  and  ap¬ 
proval  of  proposed  data  requirements.  The  request  was  then 
sent  out  of  the  command  for  contractual  and  funding  reviews 
by  the  Antisubmarine  Warfare  System  Project  Office;  was  re¬ 
ceived  back;  c  id  was  reviewed  by  command  lawyers  and  special¬ 
ists  In  small  business,  labor  surplus  areas,  security,  pat¬ 
ents,  and  various  layers  of  contract  administration.  Each 
layer  of  budgeting  activity  through  the  Chief  of  Naval  Oper¬ 
ations  was  notified  and  signed  off  on  required  reprograming 
of  funds.  The  contract  planner  also  prepared  an  advance  pro¬ 
curement  plan,  a  request  for  authority  to  negotiate,  and  a 
determination  and  findings,  which  were  subjected  to  a  similar 
approval  process  by  various  levels  and  commands  and  which 
culminated  with  the  approval  of  the  Assistant  Secretary  of 
the  Navy  (Installations  and  Logistics)  to  negotiate  with 
the  only  known  source  capable  of  fast  delivery. 
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Three  months  after  the  request  vas  initiated,  c  package 
of  prenegotiation  data,  approvals,  routing  sheets,  recommenda¬ 
tions,  funding  data  sheets,  and  other  assorted  data  vas  given 
to  a  negotiator.  Be  drafted  a  proposed  contract  and  sent  it 
to  legal,  patent  attorneys,  inspection  acceptance,  data  re¬ 
quirements,  security,  and  fiscal  groups  for  review  and  ap¬ 
proval  or  reconnendatior.s.  Af-er  considering  further  recom¬ 
mendations,  making  necessary  changes,  getting  approval  from 
legal,  obtaining  a  business  clearance  letter  from  Naval  Mate¬ 
rial  Command,  and  certifying  a  contractor's  compliance  with 
provisions  of  the  Equal  Opportunity  Act,  the  Naval  Ordnance 
Systems  Command  negotiator  was  finally  able  to  send  copies  of 
the  contract  to  the  contractor  for  signature.  After  the  con¬ 
tract  vas  signed  by  the  contractor,  it  vas  signed  by  the 
Navy's  contracting  off.cer  and  vas  sent  to  the  distribution 
center  for  reproduction. 

It  took.  4  months  on  an  expedited  "rush"  basis  to  get 
from  a  procurement  request  to  a  letter  contract, during  v.iich 
time  it  vas  subjected  to  at  least  174  control,  review,  and 
approval  points  within  74  organizational  elements  at  eight 
different  management  levels.  Allowing  ar.  average  of  21  work 
days  a  month,  the  decisionmaking  process  vas  able  to  react 
about  twice  a  day.  In  addition,  most  of  the  precontract  re¬ 
view  and  approval  viM  be  repeated  as  the  ?etter  contract  is 
definitized  into  a  negotiated  fixed-price- type  contract. 

2.  In  August  1970  the  project  manager  for  the  CHAPARRAL/ 
VIILCAH  missile  system  requested  that  the  Missile  Command  pre¬ 
pare  a  product  improvement  program  for  an  improved  guidance 
system  on  CHAPARRAL.  Also  in  August  1970  the  Deputy  Secre¬ 
tary  of  Defense  requested  that  the  Army,  Navy,  and  Air  Force 
work  together  in  exploring  the  possibility  of  obtaining  a 
common  missile,  possibly  by  adapting  the  Navy  SIDEWINDER  to 
Army  and  Air  Force  use.  The  common  missile,  if  developed, 
would  be  used  by  the  Army  in  lieu  of  CHAPARRAL. 

In  January  1971  the  Comaanding  General,  Army  Materiel 
Command,  determined  that  it  vas  not  feasible  to  replace 
CHAPARRAL  with  a  common  missile.  He  therefore  recommended 
that  the  Missile  Compand  guidance  improvement  proposal,  des¬ 
ignated  MDD-1A,  be  incorporated  in  the  CHAPARRAL. 
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A  Missile  Consmand  report,  OHAPARRAL  Improvement  Program, 
vhich  included  M0D-1a  and  an  active  optical  fuze  program, 
vas  submitted  to  the  Amy  on  February  31,  1971.  The  package 
was  returned  on  March  Z ,  1971,  for  detailed  cost  data  and 
more  justification  than  had  been  submitted.  The  Army  also 
requested  that  each  proposal  be  submitted  separately  and 
that  a  comparison  study  of  the  IJDB-lA  and  REDEYE  II  SEEKER 
be  provided.  The  Amy  Missile  Ccmnand  had  previously  re¬ 
ported  (on  January  13,  1971)  to  the  Army  that  several  in¬ 
frared  seekers,  including  REDEYE,  had  been  investigated  but 
had  been  elininated  for  consideration. 

The  revised  MOD-IA  product  improvement  program  vas  for¬ 
warded  to  the  Army  in  May,  and  the  new  MOD-  1A/ REDEYE  study 
vas  forwarded  in  June  1971. 

During  an  Air  Defense  review  in  August  1971,  an  Array 
representative  of  the  Chief,  Research  and  Development,  again 
raised  the  question  corse -*ming  use  of  the  REDEYE  SEEKER. 

The  Chief  of  Research  ana  Development  withheld  concurrence 
of  U0D-1A  undl  a  group  vent  to  the  Missile  Command  in  Sep¬ 
tember  1971  for  a  briefing  on  the  REDEYE  and  MQD-1A. 

The  project  was  finally  approved  by  the  Army  on  Decem¬ 
ber  3,  1971,  As  of  February  9,  1972,  some  17  months  after 
it  had  been  initiated,  the  project  was  awaiting  approval  in 
OSD. 


In  summary,  we  found  some  important  differences  in  the 
way  project  offices  were  organized  and  operated.  On  some 
p:  i grains  the  project  manager  is  placed  ir  an  environment 
where  he  really  does  not  have  control  over  his  project. 
Technical  fc vtures  of  his  program  are  under  the  direct  con¬ 
trol  of  others.  The  objectives  of  supporting  organizations 
are  not  necessarily  the  same  as  his.  Essentially,  all  the 
procedures  under  which  his  project  will  be  managed  are  pre¬ 
scribed.  Almost  everything  he  does  is  done  under  a  set  of 
rules  that  gives  him  flexibility  only  to  the  extent  that  he 
is  willing  to  ignore  the®.  He  has  little  control  over  his 
contractor  because  he  lacks  authority  to  make  contracts  and 
bee  mse,  in  any  event,  the  procedures  the  contractor  will  fol¬ 
low  are  prescribed  by  a  similar  set  of  rules. 
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CHAPTER  4 


ASSESSMENT  OF  CRITICAL  MANAGEMENT  ACTIONS 

We  have  included  four  specific  aspects  of  the  acquisi¬ 
tion  process  in  this  chapter.  These  areas  were  selected 
for  special  attention  because  they  1'elated  to  several  of 
the  critical  management  actions  discussed  in  last  year's 
report  and  again  in  this  report.  Also,  they  have  been  par¬ 
ticularly  troublesome  in  weapon  systems  acquisitions. 

COST  ESTIMATING  FOR  MAJOR  ACQUISITIONS 

Cost  growth  In  acquiring  weapon  systems  continues  to 
be  a  significant  problem  in  DOD.  Much  of  this  cost  growth 
Is  attributable  to  unrealistic  cost  estimates.  Ke  found 
that  the  two  overriding  factors  influencing  the  quality  of 
cost  estimates  are  (1)  the  lack,  of  completeness  of  a  plan 
stating  what  should  be  done  and  (2)  inadequate  documenta¬ 
tion  on  what  was  done  and  how  and  why  it  was  done. 

There  is  a  lack  of  uniform  guidance  on  cost-estimating 
practices  and  procedures  which  would  provide  the  basis  for 
formulating  valid,  consistent,  and  comparable  estimates 
throughout  the  services.  Each  service  has  Its  own  set  of 
guidance  for  the  estimating  function  that  ranges  from  a  de¬ 
tailed  estimating  manual  to  a  few  general  statements. 

In  virtually  every  system  we  reviewed,  documentation 
of  what  had  been  done,  and  why ,  was  clearly  lacking.  Cost 
estimates  are  frequently  a  succession  of  revisions  over  the 
previous  cost  estimate.  To  effectively  accomplish  cost 
estimates,  we  believe  that  the  documentation  must  provide  a 
complete  disclosure  of  data . sources,  assumptions  made,  meth¬ 
ods  used,  and  all  decisions  basic  to  formulating  the  esti¬ 
mate. 

There  is  a  general  lack  of  readily  retrievable  cost 
data  which  could  serve  as  a  basis  for  computing  cost  esti¬ 
mates  for  new  weapon  systems.  Officials  within  0S0  have 
stated  that  there  is  little  organized  effort  to  gather  ac¬ 
tual  cost  information  on  a  systematic  basis,  to  achieve 
comparability  between  the  data  collected  on  various  weapon 
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system* .  or  to  make  any  effort  to  see  if  the  cost  data  be¬ 
ing  reported  by  the  contractors  „s  accurate  and  consistent. 

He  suggested  that  the  Secretary  of  Defense  consider 
further  development  of  DOD-vide  guidance  for  consistent  and 
effective  cost -estimating  procedures  and  practices.  Ele¬ 
ments  of  particular  importance  are: 

1.  An  adequate  data  base  of  readily  retrievable  cost 
data. 

2.  Uniform  treatment  of  inflation. 

3.  An  effective  independent  review  of  cost  estimates. 

4.  More  complete  documentation  of  cost  estimates. 

5.  Dependable  program  definitions. 

He  believe  OSD  agrees  with  our  basic  conclusions.  To 
improve  procedures  and  practices  OSD  plans  to  take  steps  to 
provide  the  necessary  guidance  to  DOD  components.  This 
would  include  criteria  to  guide  those  charged  with  making 
estimates  and  would  establish  procedures  to  have  cost  esti¬ 
mates  available  for  use  by  the  services  and  the  Secretary  of 
Defense.  In  addition,  it  would  provide  guidance  for  the  cre¬ 
ation  and  maintenance  of  cost  data  systems  to  serve  as  a 
basis  for  computing  cost  estimates  for  new  weapon  systems. 

For  example,  in  December  1971  the  Secretary  of  Defense  asked 
the  services  to  make  available  to  DSAKC  at  each  key  decision 
point  an  "independent  parametric  cost  analysis"  in  addi¬ 
tion  to  other  appropriate  cost  estimates. 

We  were  advised  that  the  services  also  were  taking 
some  action  to  improve  their  cost-estimating  capabilities. 

For  example ,  the  Navy  has  established  a  resource  analysis 
group.  The  Army  is  assigning  a  project  officer  who  will  be 
responsible  for  the  development  of  an  independent  parametric 
estimate  for  each  system  which  either  is  covered  by  a  selected 
acquisition  report  (SAR)  or  is  subject  to  a  defense  systems 
acquisition  review  council  review.  The  Air  Force  Systems 
Command  is  about  to  reissue  its  Cost-Estimating  Manual. 


29 


COST- EFFECTIVENESS  STUDIES 


Cost-effectiveness  studies  are  one  of  the  techniques 
used  in  reaching  decisions  as  to  vhich  among  several  com¬ 
peting  weapon  systems  is  more  likely  to  achieve  a  prede¬ 
termined  mission  goal  at  the  lowest  cost.  The  overall  goal 
of  such  studies  is  to  assist  a  decisionmaker  by  arraying 
significant  factors  to  help  identify  a  preferred  system 
from  among  the  alternatives. 

A  cost-effectiveness  study  considers  the  need  a  system 
is  supposed  to  fill,  the  alternative  technical  solutions 
available  to  meet  that  need,  technical  performance  charac¬ 
teristics  of  each  alternative,  cost  associated  with  each 
possible  solution,  and  criteria  for  choosing  among  alter¬ 
natives.  The  overall  study  should  emphasize  significant 
Issues  to  clarify  merits  of  alternative  systems.  Also,  the 
analysis  should  be  updated  when  changes  in  basic  assumptions 
occur.  Updating  ensures  continuing  cost  effectiveness  of 
the  system  selected  by  allowing  for  changes  in  threat, 
technological  advancement ,  or  desired  level  of  defense. 

The  basic  elements  of  a  cost-tifectivene-s  study  in  a 
weapon  acquisition  program  are: 

— Statements  of  the  mission(s)  to  be  performed. 

—Inclusion  of  alternative  weapon  systems. 

— Disclosure  of  comparable  estimated  costs  for  each 
alternative. 

— logical  presentation  of  relationships,  including 
costs,  predicted  effectiveness,  and  assumptions . 

We  are  convinced  of  the  definite  usefulness  of  cost- 
effectiveness  studies.  '  e  believe  the  greatest  advantage 
of  the  cost-effectiveness  technique  is  that  it  forces  ad¬ 
vocates  of  a  weapon  syste.  to  examine  and  record  the  real 
need,  alternatives,  relate!  costs,  and  assumptions  consid¬ 
ered.  This  serves  to  provide  the  decisionmaker  with  a 
body  of  information  vhich  is  helpful  in  making  a  decision 
at  an  early  phase  in  the  acquisition  process.  Continual 
updating  at  major  decision  point;;  would  help  confirm  the 
development  of  the  most  cost-effective  weapons. 


In  the  cases  reviewed  we  found  that  some  weapon  system 
cost-effectiveness  studies  were  comprehensive  and  provided 
the  type  of  information  on  aspects  needed  for  decisionmaking. 
However,  we  found  also  other  studies  which  lacked  objec¬ 
tivity  and  which  appeared  to  be  designed  to  support  the  po¬ 
sition  of  the  advocating  service  in  that 

—known  al  remat ives  were  exciud'-j,  from  the  stuu/, 

— stated  assumptions  were  too  restrictive  or  were  not 
completely  valid,  and 

—available  data  on  alternatives  were  not  considered, 
and  as  a  result,  incomplete  studies  amounting  to 
misleading  information  were  furnished  for  decision¬ 
making. 

We  found  further  that  studies  were  not  updated  to  con¬ 
sider  jch  program  changes  as 

—availability  of  actual  performance  data  at  variance 
with  predicted  performance  data, 

— major  cost  or  qua  - ' i ty  changes,  and 

— major  changes  in  initial  study  assumptions. 

We  suggested  that  the  Secretary  of  Defense  emphasize 
the  need  for  cost-effectiveness  studies  and  clarify  their 
roles  as  formal  documents  supporting  development  concept 
papers  at  each  stage  of  decisionmaking  in  the  selection  of 
specific  weapon  systems.  When  two  or  more  services  are 
competing  for  a  weapon  system,  OSD  should  arrange  for  inde¬ 
pendent  cost-effectiveness  studies  impartial  to  the  service 
proposals. 
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PERFORMANCE  MEASUREMQJT 


FOR  SELECTED  ACQUISITIONS 


Department  of  Defense  Instruction  (DODI)  7CC0.2,  Per¬ 
formance  Measurement  for  Selected  Acquisitions,  vas  promul¬ 
gated  by  the  Assistant  Secretary  of  Defense  ( Comptroller)  on 
December  22,  1967.  It  is  intended  to  provide  the  criteria 
for  contractor  reporting  of  valid  and  up-to-date  data  fcr 
measuring  progress  against  cost,  schedule,  and  technical 
plans.  From  the  time  it  vas  issued,  DCD1  70GC.2  has  been 
implemented  within  the  services  with  varying  degrees  of  en¬ 
thusiasm.  The  Air  Force  has  made  substantial  progress  in 
implementation,  and  the  Army  and  Navy  are  beginning  to  make 
progress. 

Questions  concerning  interpretation  of  basic  criteria 
provided  in  the  instruction  were  major  contributing  factors 
to  the  services*  failure  to  make  better  progress.  Other 
problems  involve  the  Implementation  and  validation  process 
on  a  plantwide  basis,  validation  of  major  subcontractors, 
joint  validation  by  » •/*  procuring  agencies,  defining  measur¬ 
able  effort,  and  ev«J. _ ting  technical  pcrfomanr-e  progress. 

Adequacy  of  criteria  established 
fog  program  performance  measurement 

The  criteria  of  DGD1  7000.2  provide  the  basis  of  deter¬ 
mining  whether  contractor  management  control  systems  are  ac¬ 
ceptable.  With  one  exception,  the  lack  of  criteria  related 
to  technical  performance  measurement,  we  believe  the  criteria 
provided  in  DODI  are  pdeq-ate  for  this  purpose. 

The  DODI  criteria  have  been  designed  around  cost  and 
schedule  management  and  have  generally  excluded  technical 
performance  measurement  because  acceptable  criteria  have  not 
yet  been  developed.  Military  standard-499,  dated  July  17, 
1969,  contains  technical  performance  measurement  criteria 
which  were  approved  by  BOD  for  application  on  a  test  basis. 
These  tests  are  continuing  but  have  not  been  approved  for 
use  on  all  systems.  We  believe  that  DODI  is  a  significant 
improvement  over  past  practices  of  controlling  on  tve  basis 
of  funds  expended,  without  the  ability  to  measure  related 
work  units  accomplished. 


Status  of  implementation  efforts 


During  the  period  April  1969,  vhen  the  first  contractor 
activity  vas  validated  by  the  Air  Force,  to  February  1972, 
the  services  approved  cost/schedule  control  systems  criteria 
implementations  of  25  contractors  at  36  of  their  locations 
where  work  on  major  weapons  was  being  performed.  Of  the  78 
weapon  systems  discussed  in  chapter  5,  16  were  validated  as 
meeting  the  requirements  of  DODI  7000.2. 

In  total,  19  of  the  systems  approved  to  date  were  on 
Air  Force  contracts.  The  Navy  validated  three  contractors 
and  has  efforts  underway  at  six  locations.  Systems  in  use 
at  three  Army  contractor  locations  have  been  validated,  and 
systems  at  14  other  locations  are  currently  reccasaended  for 
validation.  In  addition,  the  Army  has  nine  core  validation 
efforts  in  process. 

Other  problem  areas 

Baseline  maintenance 


One  of  the  basic  features  of  tie  DODI  criteria  has  been 
the  employment  of  a  firm  baseline  that  enables  the  contractor 
and  the  Government  to  measure  cost  and  performance  progress. 
By  maintaining  a  firm  baseline,  program  status  can  be  pre¬ 
sented  in  terms  of  contractual  costs  and  contract  value  can 
provide  the  baselines  from  which  accomplishment  is  measured. 

We  noted  that,  on  three  programs  where  performance 
measurement  systems  had  been  validated  (F-14,  S_3A,  and  B-i), 
firm  baselines  were  not  maintained.  In  the  case  of  the  Navy 
F-14  and  S-3A  programs,  cost  variances  being  reported  are 
not  related  to  the  contractor's  original  budget  and  have  the 
effect  of  minimizing  the  extent  of  reported  cost  variances. 
Contractor  program  planning  and  control  personnel  indicate 
that  they  consider  the  flexible  budget  baseline  presently  in 
use  to  be  a  more  realistic  measurement  of  performance. 

On  the  Air  Force  B-l  program,  performance  is  measured 
against  a  short-range  budget  and  the  contractor  does  not  use, 
or  attempt  to  use,  the  time- phase 3  total  contract  plan  for 
performance  measurement.  The  rationale  given  to  us  by  con¬ 
tractor  officials  for  this  is  that  they  believe  it  is 


difficult  to  make  realistic  time-phased  estimates  for  gerw- 
eral  work  tasks  that  arc  not  defined  in  enough  detail  to- 
warrant  assignment  o?  budget  and  schedule  during  the  early 
stages  of  a  development  contra-t  for  a  sophisticated  weapon 
system. 

Use  of  approved  performance  management  systems  alone 
will  not  prevent  overruns  or  ensure  achievement  of  schedule 
or  technical  goals.  Through  proper  surveillance  by  the 
Government,  such  system ~  should  provide  early  identification 
of  problems  related  to  ost  and  progress  and  should  enable 
alternative  or  corrective  action  in  the  early  phases  of  a 
program. 

Technical  performance  measurement  has  been  recognized 
as  a  troublesome  area.  Until  some  way  is  found  to  more 
closely  relate  tec'unical  performance  achievements  to  cost 
and  schedule,  emphasis  should  be  placed  on  ensuring  that 
sufficient  critical  technical  milestones  are  included  in 
contracts  and  achievement  ensured  through  a  comprehensive 
test  and  evaluation  program. 

TESTING  gyp  EVALUATION  IK 
ACQU I SIT ION  MANAGEMENT 

The  Deputy  Secretary  of  Defense  has  enunciated,  since 
July  1909,  a  series  of  policy  statements  setting  forth  the 
framework  for  an  Improved  acquisition  process,  including 
such  goals  as  reducing  the  extent  of  concurrent  development 
and  production.  However,  we  observed  a  number  of  instances 
vhe  'e  decisions  were  made  to  advance  weapon  systems  to  some 
stage  of  production  before  completion  of  adequate  testing. 

Each  of  the  three  services  has  longstanding  policies 
that  require  the  completion  of  engineering  testing  before 
production  begins,  but  these  policies  have  been  frequently 
waived.  For  instance,  the  Army  has  such  a  policy,  but  it 
also  provides  for  waiving  the  policy  to  begin  limited  pro¬ 
duction  because  certain  exceptional  circumstances  cueist 
(i.e.,  urgency  of  need  and  low  risk).  Most,  if  not  all,  of 
the  major  weapon  systems  procured  by  the  Army  in  recent 
years  have  been  procured  under  this  waiver.  Similarly,  the 
MARK  48  torpedo,  the  F-lll  aircraft,  and  a  number  of  other 
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weapon  systems  in  the  Navy  and  Air  Force  have  entered  pro¬ 
duction  under  waivers  to  the  overall  policy. 

Ve  also  found  that: 

— The  practices  used  in  establishing  test  objectives 
were  generally  adequate;  however,  most  weapon  systems 
did  not  have  adequate  test  plans. 

— The  test  plans  generally  were  unduly  optimistic  and 
success  oriented  and  allowed  no  provision  Jor  alter¬ 
native  positions  or  time  for  repair,  if  needed. 

—Test  and  evaluation  was  not  accomplished  quickly  and 
effectively. 

— Test  and  evaluation  procedures  and  associated  termi¬ 
nology  varied  greatly  among  the  services. 

.-Complete  and  valid  test  data  was  not  always  available 
for  consideration  by  decisionmakers  at  the  key  deci¬ 
sion  points. 

We  suggest  that  DOD  policies  and  practices  regarding 
testing  consider: 

—Adequate  controls  over  granting  any  waivers  from 
required  testing  and  evaluation. 

—Completion  of  appropriate  testing  and  evaluation 
prior  to  key  decision  points  in  the  acquisition 
cycle. 
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In  our  review  this  year  we  analyzed  the  status  of  78 
major  acquisition  systems.  One  of  the  systems  we  reviewed 
(ULMS)  has  not  vet  been  approved  by  the  Secretary  of  Defense, 
and  no  program  cost  estimates  have  been  provided  to  us.  The 
estimated  cost  of  the  remaining  77  systems  has  increased 
about  $28.7  billion  from  the  cost  anticipated  in  the  planning 
estimate  to  current  estimate  through  completion.  It  has  in¬ 
creased  about  $13.4  billion  from  the  cost  anticipated  by  the 
development  estimate  to  current  estimate  through  program  com¬ 
pletion. 

As  reported  In  the  SAR  system,  these  cost  changes  are 
not  cost  growth  in  the  sense  of  measuring  cost  increases  for 
identical  programs  from  initial  baseline  to  current  estimates . 
Rather,  they  are  the  net  of  a  great  number  of  changes,  in¬ 
cluding  inf latior ,  cost  estimating,  quantities,  weapon  sys¬ 
tems  capabilities,  and  schedules.  In  effect,  the  SAR  re¬ 
porting  system  does  not  readily  identify  pure  cost  growth, 
i.e.,  increased  costs  in  constant  dollars  for  programs. 
Highlighting  such  Increases  would  emphasize  the  need  for  im¬ 
proved  cost  estimating, 

A  summary  of  program  cost  estimates  for  these  77  sys¬ 
tems  is  shown  in  the  table  below.  The  detail  for  each  sys¬ 
tem  is  shown  in  appendix  X. 
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SYSTEM  COST  EXPERIENCE 


In  past  reviews  ve  found  that  there  had  been  consider¬ 
able  changes  in  the  estimated  cost  to  complete  n  program  as 
it  moved  through  the  acquisition  process.  Present  5AR  in¬ 
structions  provide  for  classifying  cost  changes  into  nine 
categories  of  cost  va  lance.  An  analysis  of  the  changes  oc¬ 
curring  during  fiscal  year  1971  alone,  as  shown  by  the  SARs, 
clearly  illustrates  the  great  amount  of  change  that  does  ex¬ 
ist.  For  the  46  systems  on  which  information  was  available 
at  June  30,  1971,  ve  found  that  cost  changes  totaled 
$30.8  billion  in  fiscal  year  1971.  These  changes  are  ana¬ 
lyzed  below  by  type  of  change  and  by  military  department 
and  are  discussed  in  detail  in  subsequent  sections  of  this 
chapter. 
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Our  analysis  of  cost  changes  of  weapon  systems  on  SAR 
at  June  30,  1970,  and  June  30,  1971,  is  graphically  shown 
on  the  following  page. 
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Quantity  changes- -$11 ,212. 5  million 

Continued  cost  growth  and  the  need  to  stay  within  the 
established  budgetary  limitations  resulted  in  a  significant 
reduction  in  the  number  of  units  to  be  acquired  for  many 
major  systems.  The  effect  of  these  quantity  reductions  is 
to  obscure  program  cost  growth  and  sometimes  performance 
capability  and  to  increase  the  unit  costs  of  the  remaining 
wits  to  be  acquired. 

Quantity  changes  on  Army  systems  amounted  to  $512.6  mil¬ 
lion  which  was  related  mainly  to  the  SAFEGUARD  program  and 
which  was  attributed  to  deleting  area  defense  from  the  pro¬ 
gram. 


Quantity  changes  on  Air  Forr.e  systems  amounted  to 
$239.4  million  which  was  related  to  idle  B-l,  F-lll,  and 
MIKUTEMAN  111  systems.  The  changes  were  attributed  to  a 
reduction  of  B-l  flight  test  aircraft  from  five  to  three, 
deletion  of  MINUTEMAN  III  research  and  development  and  pro¬ 
duction  missiles,  and  termination  of  aircraft  cn  the  F-lll 
program . 

The  greatest  quantity  change,  $10,460.5  million,  oc¬ 
curred  on  Navy  systems.  During  fiscal  year  1971  the  Navy 
reduced  the  DLGN-38,  LHA,  DD-963,  F-14,  and  PHOENIX  programs 
by  nearly  $9  billion  through  quantity  reductions .  In  addi¬ 
tion,  our  analysis  indicates  that  the  SSN-688  had  a  quantity 
decrease  of  $15  billion  from  last  year.  However,  this  indi¬ 
cated  quantity  reduction  is  the  result  of  a  change  in  base¬ 
line,  and  actually  the  SSN-688  program  had  a  quantity  in¬ 
crease  of  about  $900  million  in  fiscal  year  1971.  The  only 
other  Navy  program  to  show  an  increase  in  fiscal  year  1971 
was  the  A-7E  aircraft  which  had  a  quantity  increase  of  about 
$315  million. 

Engineering  changes--$1.613.8  billion 

An  alteration  in  the  established  physical  or  functional 
characteristics  of  a  system  is  called  an  engineering  change. 
Incomplete  descriptions  of  initial  performance  specifications 
and  changes  required  to  bring  system  performance  up  to  ex¬ 
pected  standards  have  resulted  in  substantial  engineering 
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changes.  The  three  nilitary  services  reported  engineering 
changes  of  $1,613.8  million  for  46  major  acquisition  systems 
in  fiscal  year  1971. 

The  Amy  reported  engineering  changes  of  $167.5  million 
primarily  attributable  to  expected  savings  based  on  MBT-70 
vehicle  design  austerity  and  increased  cost  for  the  CHEYENNE 
due  to  changes  in  the  night  vision  system,  system  modifica¬ 
tions,  and  related  TOW  development  effort.  The  Navy  and 
Air  Force  reported  engineering  changes  of  $702.2  million 
and  $744.1  nillion,  respectively.  The  Navy  changes  are  pri¬ 
marily  related  to  sonars,  electronics  communication ,  and 
test  equipment  for  the  DE-1052  and  to  a  need  to  deliver  DLG 
modernization  ships  vhich  meet  the  latest  specifications 
for  operability.  The  Air  Force  reported  engineering  changes 
vhich  are  attributable  to  increases  for  design  evolution  on 
the  B-l  aircraft  and  to  decreases  on  the  MINUTEMAN  II  and 
III  due  to  deletion  of  equipment  and  cost  refinements  for 
force  modernization  and  reduced  systems  engineering  and 
technical  direction. 

Support  changes — $1,130  million 

Support  changes  involve  such  items  as  spare  parts,  an- 
cilliary  equipment,  warranty  provisions,  and  Government- 
furnished  property  and/or  equipment.  During  fiscal  year 
1971  support  changes  reported  by  the  three  military  services 
totaled  $1,130  million. 

The  Army  had  support  changes  of  $167.7  million  pri¬ 
marily  related  to  the  SAFEGUARD  due  to  revised  spares  re¬ 
quirement,  added  equipment,  and  MBT-70  systems  for  product 
ensurance,  maintenance  engineering,  testing,  and  parts. 

The  Navy  had  changes  of  $445.5  million  primarily  related  to 
the  S-3A  for  costs  associated  with  VAST  programming,  crew 
position  trainers,  and  miscellaneous  support;  to  the  P-3C 
for  cost  due  to  a  revised  investment  spares  requirement; 
and  to  the  VAST-247  for  special  support  equipment  for  onsite 
maintenance  and  basic  spares  program.  The  Air  Force  had 
changes  of  $516.8  million  related  to  decreases  for  MINUTEMAN 
III  due  to  reduced  support  at  the  western  test  range  and  to 
reductions  in  support  items,  such  as  ground  support  equip¬ 
ment  data  and  modifications,  and  increases  for  the  F-lll  due 
to  a  reassessment  of  the  program  cost  of  support  items. 


41 


Schedule  changes- - $1.445. 5  million 


Schedule  changes  reflect  adjustments  in  the  delivery 
schedule,  completion  date,  or  some  Intermediate  milestone 
of  development  or  production.  The  three  military  services 
reported  schedule  costs  changes  of  $1,445.5  million  for  46 
major  acquisition  systems  in  fiscal  year  1971. 

The  Army's  schedule  changes  of  S156.6  million  are  pri¬ 
marily  attributable  to  the  SAFEGUARD  as  a  result  of  stretch¬ 
out  costs  resulting  from  a  longer  deployment  pericd.  In  ad¬ 
dition,  the  Army  had  some  minor  schedule  changes  in  the 
LANCE,  DRAGON, and  TACFIRE  systems.  Air  Force  schedule 
changes  of  $364.7  million  resulted  from  a  stretchout  of  the 
B-l  production  rate  and  funding  constraints  and  a  production 
rate  slowdown  of  the  C-5A  from  three  to  two  aircraft  a 
month.  The  Navy  had  the  biggest  schedule  change  of 
$924.2  million.  This  change  is  attributed  to  a  redirection 
of  the  F-14  program,  to  a  revised  fiscal  year  production 
buy  of  the  PHOENIX  missile,  and  to  the  A-7E  system  because 
of  program  stretchout  and  an  invalid  cost  quantity  curve. 

For  reporting  purposes  identifying  such  schedule  ad¬ 
justments  is  important.  Our  findings  indicate  that  such 
adjustments  are  indicative  only  of  other  fundamental  prob¬ 
lems.  Schedule  changes,  as  such,  are  not  a  primary  cause 
of  cost  growth  but  are  rather  the  result  of  a  management 
weakness  or  mistase. 


Econonic  uhanees--$4.176. 5  mllli.cn 

Economic  changes  reflect  the  influence  of  one  or  more 
factors  in  the  economy.  Included  are  specific  contract 
change?  deriving  from  economic  escalation  and  changes  in 
quantity — changing  program  estimates  to  reflect  a  revised 
economic  forecast  or  changing  actual  contract  quantities. 

The  reported  economic  changes  for  -6  systems  in  fiscal  year 
1971  was  $4,176.5  million. 

Such  systems  as  the  SAFEGUARD,  SAM-D,  and  MBT-70  account 
for  cost  of  the  Army's  economic  change  of  $1,326.9  million 
in  fiscal  year  1971.  The  Navy's  DO-963,  S-3A,  DLG  modern¬ 
ization,  DLGN-38,  and  SSN-637  account  for  most  of  **s 
$1,251.3  million  economic  change. 

The  Air  Force  had  the  largest  economic  change, 

$1,598.3  million,  related  primarily  to  the  B-l  due  to 
revising  the  program  estimate  from  fiscal  year  1970  dollars 
to  then-year  dollars  and  to  the  F-lll  to  provide  for  esca¬ 
lation  to  complete  the  current  program. 

Estimating  changes— $5.469.9  million 

Estimating  changes  in  ft  program  or  project  cost  are 
due  to  correctioi  s  and  refinements  in  earlier  estimates. 

In  fiscal  year  1971  the  total  reported  estimating  change 
for  the  46  systems  was  $5,469.9  million. 

Army  changes,  -mounting  to  $295.8  million,  related  to 
SAFEGUARD  for  program  increases  and  refinement  and  revision 
of  previous  estimates  and  to  the  MBT-70  program  for  advanced 
production  engineering  and  increased  testing  support. 

The  Air  Force  had  estimating  changes  of  $2,287.1  mil¬ 
lion  related  to  a  revised  program  estimate  of  the  C-5A,  to 
the  F-lll  because  of  contractor  price  increases,  to  the 
SRAM  as  a  result  of  the  def ini ti ration  of  the  production 
contract,  to  the  MINUTEMAN  III  because  of  a  deletion  of 
missiles  and  program  adjustments,  and  to  the  B-l  program 
as  a  result  of  revised  past  estimating  methodology. 
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The  Navy  had  an  estimating  change  of  $2,887  million 
attributable  primarily  to  the.  >iARK-48  program  due  to  program 
reductions  and  revised  program  estimates  based  on  the  award 
of  the  production  contract. 

Sundry  chanees~-$2.553.7  million 

Sundry  changes  provide  for  all  other  miscellaneous 
changes  wnich  occur  during  the  acquisition  process.  These 
changes  would  include  (1)  unpredictable  changes,  such  as 
acts  of  God,  work  stoppage,  ar.d  changes  to  Federal  and  State 
laws,  (2)  contract  performance  incentives  changes  resulting 
from  contractor  performances'  being  different  from  those 
predicted,  and  (3)  changes  due  to  contractors'  actual  contract 
costs'  being  over  or  under  anticipated  contract  costs,  but 
not  attributable  to  any  other  category  of  cost  growth.  In 
fiscal  year  1971  the  three  military  services  reported  cost 
changes  of  $2,553.7  million  on  46  major  acquisition  systems. 

The  Army  had  changes  of  $66.5  million  as  a  result  of 
converting  the  CH£YEN?3  contract  to  a  cost-reimbursable 
type  and  adjusting  a  contractual  cost  for  the  SAM-D  missile. 

The  Air  Force  had  sundry  changes  of  $1,926.2  million 
primarily  related  to  the  reclassification  of  MINUTEMAN 
rebasing  costs,  to  MINUTEMAN  III  force  modernization, and  to 
the  MINUTEMAN  II  upgrade  silo  program. 

The  Navy  had  sundry  changes  of  $561  million  related  to 
management  problems,  restoration  costs  of  a  submarine  and 
underestimates  on  the  SSN-637  program,  contractor  claims  on 
the  DE-1052,  and  contractor  overruns  on  the  PHOENIX  missile. 

Unidentified  changes — $2.296.4  million 

Our  report  last  year  showed  that,  for  certain  Navy 
systems,  the  cumulative  variance  analysis  and  the  variance 
analysis  changes  since  the  previous  reporting  period  either 
had  not  been  provided  or  were  cot  complete.  For  this  reason 
cost  changes  totaling  $2,296.4  million  were  not  allocated 
specifically  to  cost  growth  categories.  Our  review  this 
year  showed  that  the  Navy  had  corrected  this  matter  and 
allocated  all  cost  variances  to  ±e  nine  cost  categories 
established  for  the  SAR  system. 
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SYSTEM  SCHEDULE  EXPERIENCE 


Schedule  changes  reflect  adj ustoents  In  delivery  dates, 
completion  dates,  initial  operational  capabili-y  da-ea,  or 
other  major  program  milestones.  GAO  findings  aave  indicated 
that  schedule  variances  are  not  the  cause  .-t  program  problems 
but  are  rather  the  result  of  technical,  financial,  or  other 
management  problems.  We  found  that  the  reasons  most  fre¬ 
quently  cited  for  schedule  slippages  are  technical  develop¬ 
ment  and  production  problems ,  funding  problems,  sr/srcn 
design  and  contract  changes,  overly  optimistic  original 
schedule  estimates,  program  stretchouts,  or  late  "reliability 
of  Government-  or  contractor- furnished  equipment. 

A  key  schedule  milestone  is  the  initial  operational 
capability  (IOC)  date.  The  IOC  date  is  normally  established 
by  a  military  service  as  the  time  vben  the  capability  of  a 
new  system  is  required  to  counter  a  specific  eneay  threat  or 
to  provide  another  essential  need  of  the  military  service. 

It  is  essential  that  schedule  slippages  and  the  reasons  for 
slippages  be  identified  as  early  as  possible  so  management 
can  make  prompt  decisions. 

The  following  chart  shows  schedule  slippage  between 
the  planned  IOC  date  and  the  current  estimate  of  the  IOC 
date  at  June  30,  1971. 
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FIGURE  IV 


ststcm  p-yyoay.-veE  experience 

The  justification  for  selecting  a  particular  major 
defense  system  to  fuif.li  a  need  includes  analysis  of  oany 
existing  &r*a  alternative  capabilities  arid  the  establishment 
of  a  relative  priority  of  need.  In  establishing  the  capa¬ 
bilities  recurred  of  a  new  system,  it  is  important  that 
clear  perfcrnance  goals  be  defined  early  in  the  development 
process.  The  achievement  of  performance  goals  Is  dependent 
on  the  solution  of  knovn  and  unknown  technical  theories  and 
concepts.  The  successful  development  of  a  major  defense 
system  is  aost  likely  to  depend  on  solutions  to  technical 
unknowns  or  changing  techniques  between  stated  operating 
requirements,  engineering  design,  and  cost  considerations. 

In  our  reviews  of  -jajor  defense  systems,  we  have  found 
that  the  reasons  for  significant  performance  variances  fall 
into  three  principal  categories;  (1)  desire  to  upgrade  per¬ 
formance  and  reliability  as  technological  advancements  are 
recognized,  (2)  inaccurate  or  overly  optimistic  estimates 
of  performance,  and  (3)  changed  design  to  increase  capability 
and/or  to  correct  deficiencies.  However,  this  is  ra>t  to  say 
that  system  performance  characteristics,  once  defined,  must 
never  be  changed.  F  c  management  to  be  effective,  it  must 
be  kept  apprised  of  unanticipated  technical  unknowns  and 
their  potential  effects  on  a  system's  performance  in  order 
that  proper  change  analyses  can  be  performed  ar.d  up-to-date 
decisions  can  be  made. 


CHAPTER  6 


SELECTED  ACQUISITION  REPORTING  SYSTEM 

Our  Initial  review  of  the  SaR  system  was  undertaken  in 
August  1969,  and  the  results  were  published  in  our  report 
"Status  of  the  Acquisition  of  Selected  Major  Weapon  Systems" 
(B-163Q5S ,  Feb,  6,  1970). 

In  that  report  we  concluded  that  the  SAR  system,  in 
concept,  represented  a  meaningful  management  tool  for  measur¬ 
ing  and  tracking  the  progress  of  major  acquisition  systems. 
Like  any  new  reporting  system,  the  SAR  system  had  some  seri¬ 
ous  shortcomings  and  improvements  were  essential.  We  found 
that  SAR  had  failed  to  show  such  significant  matters  as  (1) 
a  comparison  of  technical  performance  actually  demonstrated 
with  that  specified  in  the  contract,  (2)  the  status  of  key 
subsystems  essential  to  mission  accomplishment,  (3)  costs 
incurred  in  relationship  to  the  costs  that  should  have  been 
incurred,  (4)  significant  pending  decisions  that  may  have  an 
impact  on  the  program,  and  (5)  a  comparison  of  quantities 
delivered  with  those  scheduled  to  be  delivered  at  the  same 
point  in  time. 

DOD — in  an  attempt  to  improve  the  format,  content,  and 
data  in  SAR — revised  DGDt  7000.3  in  December  1969  and  again 
in  June  1970. 

Our  second  review  of  the  SAR  system  was  undertaken  in 
August  1970,  and  the  results  were  published  in  our  report 
"Acquisition  of  Major  Weapon  Systems"  (B-L  058,  Mar,  18, 
1971).  That  review  confirmed  that  improve  ints  had  been 
made  since  our  first  report  was  issued  bv  that  some  improve¬ 
ments  were  still  needed.  We  concluded  thai  SAR  still  did  not 
(1)  contain  a  summary  statement  regarding  overall  accept¬ 
ability  of  the  system  for  part  or  all  of  its  mission,  (2) 
recognize  the  relationship  of  other  weapon  systems  comple¬ 
mentary  to  the  subject  system,  or  (3)  reflect  the  current 
status  of  program  accomplishment, 

RESULTS  OF  CURRENT  REVIEW 

Over  the  past  18  months  the  SAR  system  has  been  in¬ 
creasingly  accepted  throughout  DUD  as  a  useful  management 
tool.  Thus  SAR  has  changed  from  a  report  used  to  monitor 
progress  of  selected  major  acquisition  to  a  comprehensive 
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summary  status  report  for  management  vithin  DOD.  The  vide 
acceptance  of  SAR  as  a  key  management  report  is  a  significant 
achievement  in  itself,  and  our  review  this  year  was  directed 
at  evaluating  SAR  from  the  standpoint  of  its  value  to  man¬ 
agement  . 

In  August  1971  ve  initiated  our  third  review  of  the  SAR 
system.  This  review  showed  that  DOD  was  continuing  to  im¬ 
prove  the  SAR  system.  Two  principal  problems  identified 
related  to  changing  baselines  for  measuring  progress  and 
credibility  af  cost  estimates.  Their  effect  on  management 
decisions  is  discussed  below. 

Heed  to  report  static  baselines 

To  accurately  evaluate  the  progress  of  a  major  defense 
system,  it  is  essential  to  have  a  static  baseline  from  which 
changes  can  be  measured  and  evaluations  can  be  made.  When  a 
system  is  initiated  in  the  acquisition  process,  DOD  estab¬ 
lishes  a  planning  estimate  in  SAR  as  the  baseline  from  which 
progress  is  to  be  measured.  However,  this  baseline  is  dropped 
from  SAR  when  the  system  moves  into  development.  From  then 
on  the  development  estimate  becomes  the  baseline  for  manage¬ 
ment  analysis  purposes.  The  development  estimate  for  cost, 
schedule,  and  performance  characteristics  is  to  ba~that  es¬ 
timate  which  is  approved  by  the  Secretary  of  Defense  author¬ 
izing  the  program  to  move  into  full-scale  development.  Cbce 
the  development  estimate  is  established,  it  is  not  to  be 
changed  unless  specific  permission  is  granted  by  the  Assistant 
Secretary  of  Defense  (Comptroller).  A  change  to  the  baseline 
tends  to  obscure  important  data  requiring  management  actions 
subsequent  to  baseline  setting. 

The  acquisition  process  covers  a  time  span  of  many  years, 
and  the  management  vithin  DOD  changes  from  time  to  time. 

Thus,  it  is  extremely  important  that  proper  baselines  be  es¬ 
tablished  and  maintained  so  that  management  can  always  eval¬ 
uate  the  progress  of  the  program  and  can  make  proper  deci¬ 
sions. 

The  first  HARRIER  SAR  was  not  prepared  until  June  30, 
1971,  although  the  Navy  had  been  buying  the  aircraft  for 
some  time. 


49 


The  HARRIER  program  did  not  follow  the  normal  acquisi¬ 
tion  process  since  it  represented  an  off-the-shelf  procure¬ 
ment  of  an  existing  aircraft.  Procurement  was  initially 
approved  by  the  Secretary  of  Defense  in  September  1968,  and 
the  first  production  contract  was  awarded  in  December  1969. 

In  the  appropriation  hearings  requesting  funds  for  fiscal 
years  1970  and  1971,  the  program  cost  was  estimated  to  be 
about  $385  million.  We  believe  this  estimate  represents  the 
program  estimate  at  the  time  the  Secretary  of  Defense  approved 
the  program  and  should  be  shown  in  SAR  as  the  baseline  for 
tracking  the  progress  of  the  HARRIER.  However,  the  June  30, 
1971,  SAR  uses  a  January  1971  estimate  of  $503  million  as  the 
baseline.  As  a  result  of  using  this  January  1971  program 
estimate,  SAR  will  not  disclose  to  management  the  program 
cost  changes  or  the  reasons  for  these  changes  which  have  oc¬ 
curred  since  the  Secretary  of  Defense  approved  the  program 
over  3  years  earlier. 

Heed  for  complete  and  realistic  cost  estimates 

The  acquisition  of  a  major  defense  system  is  a  highly 
complex  operation  which  involves  a  substantial  long-range 
commitment  of  future  expenditures.  As  discussed  in  chapter  4 
of  this  report,  accurate,  complete,  and  realistic  cost  esti¬ 
mates  are  essential  in  evaluating  the  progress  of  major  de¬ 
fense  systems  and  in  making  decisions  on  the  system's  future 
progress.  We  found  that  the  most  common  reasons  for  incom¬ 
plete  and  unrealistic  cost  estimates  on  SAR  are  (1)  a  lack 
of  complete  program  definition,  (2)  overoptimism  on  the  part 
of  program  personnel  to  perform  tasks  and  solve  problems, 

(3)  the  uncertainty  of  the  effects  of  economic  and  world 
political  factors  on  a  system  during  the  long  acquisition 
process,  and  (4)  a  requirement  for  current  estimates  to  com¬ 
ply  with  budgetary  documents. 


CONGRESSIONAL  VISIBILITY  OVER 
MAJOR  DEFENSE  ACQUISITIONS 

The  effectiveness  of  the  Congress  in  reviewing  end  con¬ 
sidering  budget  proposals  and  contract  awards  for  procuring 
weapon  systems  is  directly  proportional  to  the  adequacy  and 
timeliness  ef  information  upon  which  it  is  to  base  its  judg¬ 
ment.  The  Congress  has  stated  that  its  need  for  such  infor¬ 
mation  on  a  recurring  basis  is  a  direct  reflection  of  the 
frustration  it  has  experienced  in  being  surprised  by  cost 
overruns. 

Requirements  of  section  506 


In  making  its  judgments  on  DOS  requests  for  funds  for 
major  defense  systems,  the  Congress  gets  information  from 
numerous  sources,  such  as  hearings,  congressional  authoriza¬ 
tion  data  sheets  (submitted  annually  for  the  past  3  years), 
and  SARs  (submitted  quarterly).  However,  the  Congress  has 
stated  that  these  reports  either  have  been  too  late  or  have 
been  lacking  in  sufficient  detail  to  satisfy  its  needs.  To 
improve  this  situation  the  Congress  included  in  Public  Law 
92-156,  dated  November  17,  1971,  section  506  which  requires 
the  Secretary  os  Defense  to  submit  annual  reports,  staxting 
in  1972  on  dc.  ole o rent  schedules  and  procurement  schedules, 
than  in  1973,  Including  data  on  operational  testing  and 
evaluation  for  apon  systems  for  which  procurement  funds 
are  requested.  In  addition,  supplemental  reports  are  re¬ 
quired  to  be  submitted  30  to  60  days  prior  to  awarding  a 
procurement  contract. 

POD' s  compliance  with  section  506 

DQD  has  responded  to  section  506  by  fonralizing  and 
adding  inform-  to  the  congressional  data  sheets  forwarded 
to  the  Congre:-  in  January  for  each  major  defense  system  for 
which  procurer  - p,t  funds  are  requested.  In  January  1972  con¬ 
gressional  data  sheets  containing  development  and  procurement 
schedules,  together  with  year-by-year  funding  information, 
were  submitted  to  certain  congressional  committees  for  some 
70  major  defense  s  'terns.  Also,  a  procedure  was  recently 
established  by  DOD  o  submit  a  supplemental  report  to  tlae 
Congress  not  less  t.-jtn  30  and  not  sore  than  60  days  before 
awarding  a  contract  or  exercising  an  option  n  a  contract 
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for  the  procurement  of  a  major  veapon  system.  DOD  is  in 
the  process  of  formalizing  requirements  to  incorporate  oper¬ 
ational  test  and  evaluation  data  in  the  congressional  data 
sheets  and  expects  to  have  this  data  in  its  January  1973 
data  sheets. 

Observations 

There  is  a  need  to  reassess  the  criteria  for  including 
weapon  systems  on  SARs  and  the  number  of  systems  for  which 
the  Congress  should  receive  status-type  information. 

In  response  to  our  request,  DOD  assembled  a  listing  of 
major  defense  systems  as  of  June  30,  1971.  This  list  to¬ 
taled  141.  However,  as  of  June  30,  1971,  52  systems  were 
reported  on  SAR  and  only  37  of  the  52  were  sent  to  the  Con¬ 
gress.  Major  weapons  are  considered  for  SAR  reporting  if 
they  meet  certain  dollar  guidelines  or  are  designated  for 
coverage  by  the  Secretary  of  Defense. 

We  believe  a  dollar  criteria  for  including  a  system  on 
SAR  is  not  enough.  One  additional  criteria  could  be  to  re¬ 
port  the  cost,  performance,  and  schedule  status  of  a  complete 
weapon  system  by  including  all  subsystems  within  the  system. 
For  example,  the  AX  and  B-l  SARs  could  contain  data  on  arma¬ 
ment  and  avionics  subsystems  and  the  DE-1052  SAR  could  in¬ 
clude  data  on  ship  subsystems.  This  type  of  reporting  would 
provide  more  comprehensive  reporting  and  would  also  provide 
management  with  a  better  basis  for  evaluating  complete  sys¬ 
tems. 


Regarding  the  type  of  information  which  is  of  vital 
interest  to  the  Congress,  both  SAR  and  congressional  data 
sheets  contain  pertinent  information.  Section  506  certainly 
will  improve  this  information.  However,  as  the  Congress  has 
stated,  it  is  interested  in  being  provided  with  consolidated 
development  and  test  data  before  key  decision  points,  such 
as  the  initial  major  procurement  award  of  a  system. 

It  is  our  belief  that  there  will  be  some  gaps  in  the 
testing  information  which  will  be  provided  to  the  Congress. 
For  instance,  there  is  no  provision  for  the  Congress  to  be 
advised,  either  in  SAR  or  in  congressional  data  sheets,  on 
ell  testing  and  evaluation  which  occurs  prior  to  the 


s: 


production  phase  of  the  acquisition  process .  It  is  our 
understanding  that  the  congressional  data  sheets  provided  by 
DOD  will  contain  information  on  operational  testing  and 
evaluation  only  for  systems  which  are  in  production  or  which 
are  ready  to  enter  production. 

GAO  intends  to  continue  work  in  these  areas  in  coopera¬ 
tion  with  DOD  to  assist  the  Congress  in  obtaining  the  infor¬ 
mation  required  to  exercise  its  authorization  and  appropria¬ 
tion  responsibilities. 
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CHAPTER  7 


GENERAL  OBSERVATIONS.  CONCLUSIONS. 

AND  RECOMMENDATIONS 

The  stages  of  de/elopment  in  the  acquisition  process  of 
the  systems  ve  reviewed  during  the  year  did  not  provide  an 
opportunity  to  look  at  all  critical  management  actions,  but 
our  overall  assessment  supports  our  previous  observation 
that  certain  areas  remain  particularly  troublesome.  In¬ 
cluded  are  stability  of  programs  and  organization  for  pro¬ 
gram  management,  which  we  also  discussed  in  last  year's  re¬ 
port. 

As  previously  reported  OSD  and  the  services  had  insti¬ 
tuted  improvement  programs  that,  when  fully  implemented, 
should  lead  to  better  management.  More  than  2  years  have 
passed  since  these  programs  started,  but  measurable  progress 
is  difficult  to  assess.  Those  problems  we  reported  last 
year,  insofar  as  we  can  see,  continue  to  plague  management. 
These  include  compromised  performance,  delayed  availability, 
and  increased  costs. 

General  observations  on  the  matters  we  have  studied, 
conclusions  we  have  drawn  from  that  review,  and  our  recom¬ 
mendations  follow. 

PROGRAM  STABILITY 

Although  it  may  be  too  early  for  the  influence  of  DOD's 
revised  PPBS  system  to  be  felt,  we  find  little  evidence  of 
any  significant  progress  in  implementing  this  system  at  the 
service  level.  S .ability  of  programs  is  highly  dependent 
on  stable  program  direction  and  on  effective  early  require¬ 
ment  planning.  There  is  considerable  evidence  that  weapon 
systems  are  conceived  and  justified  as  independent  systems, 
and  history  shows  that  such  systems  are  subject  to  substan¬ 
tially  greater  instability  in  requirements. 

Changes  to  weapons  programs  are  related  to  delivered 
products  (hardware) ,  and  these  changes  were  not  consistent 
with  original  statements  of  need  or  with  earlier  indica¬ 
tions  of  the  important  relationships  between  one  system  and 
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another.  There  is  a  quastion  vfcether,  in  the  conceptual 
stages,  attempts  are  nade  to  establish  clearly  the  precise 
use  to  which  the  weapon  will  be  put  or  the  impact  of  one 
weapon  proposal  on  other  programs  and  on  the  total  force 
structure  of  a  service. 

Other  reasons  for  program  changes  are  the  increasing 
cost  of  the  item  itself  or  the  need  to  make  funds  available 
for  a  newer  system  just  coning  into  development  as  a  result 
of  the  possible  ceiling  on  dollar  resources. 

Changes  in  weapon  system  development  are  inevitable, 
but  in  view  of  the  fact  that  the  dynamic  changes  involving 
systems  represent,  to  a  large  degree,  a  natter  of  judgment , 
checks  and  balances  become  imperative . 

This  situation  becomes  even  more  critical  since  in 
many  cases  there  was  no  clear  indication  that  the  changes 
we  saw  in  weapon  system  development  were  related  in  a  major 
way  to  a  changing  threat. 

Last  year  ve  talked  about  the  possibility  of  program 
management 1  s  evolving  along  mission  lines — acquisition  plan-* 
ning  that  thinks  of  weapon  systens  as  components  of  a  larger 
mission  system  in  terms  of  their  being  available  at  the 
same  time  and  working  together.  COD  is  currently  working  on 
the  development  of  a  total-force  concept  in  which  the  men 
and  equipment  of  each  service  are  used  most  effectively. 
These  are  steps  in  the  right  direction. 

Recommendations 

We  recommend  that  the  Secretary  of  Defense  take  action 
to  supplement  the  changes  made  to  date  by  ensuring  the  ac¬ 
complishment  of: 

1.  A  continuing  rigorous  analysis  (accompanied,  where 
possible,  with  test  data)  of  the  needs  of  new  weapon 
systems  and  the  use  to  which  they  will  be  put. 

2.  A  careful  analysis  of  the  impact  of  proposed  needs 
on  the  manpower  and  dollar  resources  of  the  total 
force  as  well  as  the  implication  to  the  plans  for 
the  usefulness  of  the  equipment  already  in.  the  in¬ 
ventory  . 
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3.  Continuing  cost-effectiveness  studies  of  proposed 
needs  versus  alternative  solutions  and  of  major 
changes  subsequent  to  initial  system  development 
approvals. 

4.  The  inclusion  throughout  the  acquisition  process 

of  a  properly  structured  process  which  makes  trade¬ 
offs  between  different  means  of  fulfilling  a  func¬ 
tion. 

ORGANIZATION.  STAFFING.  AND  PROCEDURES 

There  are  major  differences  within  the  three  military 
departments  in  the  organization,  operation,  and  staffing  of 
the  program  management  offices  that  are  charged  with  the  re¬ 
sponsibility  of  acquiring  major  weapon  systems.  Although 
the  differences  in  military  rank,  organizational  levels, 
and  numbers  of  people  are  fairly  apparent,  the  differences 
in  actual  authority  and  operating  decisionmaking  powers  are 
more  significant  but  less  apparent. 

Although  the  project  management  concept  has  evolved 
into  a  fairly  precise  and  highly  effective  method  of  ac¬ 
quiring  major  weapon  systems,  implementation  of  the  concept 
has  been  less  than  effective.  Systems  selected  for  project 
management  appear  to  have  been  based  primarily  on  total  re¬ 
sources  involved,  rather  than  degree  of  technical  risk,  ag¬ 
gressive  management,  and/or  system  Interface  and  integration 
that  is  necessary.  Similarly,  the  relationship  of  one  weapon 
system  to  another,  the  relationship  of  interdependent  systems 
and  subsystems ,  and  the  role  of  a  weapon  being  acquired  in  a 
total  capability  do  not  seem  to  be  part  of  the  selection 
criteria. 

Once  a  system  is  selected  for  project  management,  where 
are  inherent  technical,  system  interface,  and  economic  prob¬ 
lems  of  a  magnitude  to  challenge  any  program  manager.  His 
job  becomes  inordinately  more  difficult  when  he  encounters 
organizational  problems,  functional  disputes,  and  procedural 
delays . 

We  see  evidence  of  considerable  progress  in  '  V  wing 
the  project  manager's  stature  and  training — furt\  *  tuyres- 
can  now  be  achieved  in  his  operating  environment.  Ve 
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believe  it  is  not  practicaole  to  create  a  model  project 
manager  structure  that  will  fit  automatically  every  major 
weapon  acquisition,  but  we  tre  convinced  that  the  manage¬ 
ment  structure  for  each  acquisition,  should  be  tailored  to 
that  particular  program. 

This  would  entail  easing  the  constraints  on  the  project 
manager's  decisionmaking  power,  and  to  that  extent  the 
organizational  layering  problem  should  diminish.  Clear 
lines  of  authority  and  responsibility  have  to  be  drawn  to 
permit  realistic  decisions  on  balanced  staffing  between 
activities  that  are  project  managed  and  functionally  managed. 

Reconmendat ions 

Ve  recommend  that  the  Secretary  of  Defense  and  the 
military  services  reexamine  the  criteria  by  which  projects 
are  selected  for  project  management -  For  those  acquisitions 
selected  under  that  criteria,  the  functions  that  are  to  be 
performed  by  a  particular  project  manager  and  those  which 
are  not,  on  a  case-by-case  basis,  should  be  spelled  out  more 
specifically  in  each  program  or  project  manager's  charter. 
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COST  ESTIMATING  FOR  MAJOR  ACQUISITIONS 

Realistic  cost  estimating  is  a  valuable  tool  available 
to  both  the  Congress  and  agency  management  for  program  se¬ 
lection,  evaluation,  and  cost  control  during  the  weapon 
system's  acquisition  process.  Previous  GAO  reports  have 
shown  that  estimates  of  the  cost  to  develop  and  produce  a 
weapon  system  are  frequently  understated  for  a  number  of 
reasons.  A  considerable  amount  of  the  cost  growth  related 
to  the  acquisition  of  weapon  systems  is  directly  attributed 
to  unrealistic  cost  estimates.  The  two  overriding  factors 
influencing  the  quality  of  cost  estimates  are  the  lack  of 
completeness  of  a  plan  stating  what  should  be  done  and  in¬ 
adequate  documentation  on  what  was  done  and  how  and  why  it 
was  done. 

We  believe  that,  without  these  two  essential  ingredi¬ 
ents — a  plan  and  a  record  of  actions — it  is  virtually  im¬ 
possible  for  management  to  intelligently  select  proper  sys¬ 
tems  for  development  and  then  to  control  those  systems  and 
manage  the  total  acquisition  process. 

We  recommend  that  the  Secretary  of  Defense  develop  and 
implement  DOD-wide  guidance  for  consistent  and  effective 
cost-estimating  procedures  and  practices  particularly  with 
regard  to  Cl)  an  adequate  data  base  of  readily  retrievable 
cost  data,  (2)  uniform  treatment  of  inflation,  (3)  an  effec¬ 
tive  independent  review  of  cost  estimates,  (4)  more  complete 
documentation  of  cost  estimates,  and  (S)  dependable  program 
definitions.  The  Secretary  concurred  in  these  suggestions 
and  advised  us  that  several  programs  were  currently  underway 
to  improve  this  cost-estimating  process. 

TESTING  AND  EVALUATION  IN  ACQUISITION  MANAGEMENT 


Testing,  another  key  management  control  in  the  acquisi¬ 
tion  process,  provides  visibility  to  problem  areas  and  en¬ 
ables  management  to  make  informed  judgments  on  the  progress 
of  weapon  development.  Our  study  revealed  no  uniformity  of 
procedure  or  universally  accepted  terminology  in  the  test¬ 
ing  area.  In  those  areas  where  various  testing  processes 
had  been  established,  there  were  so  many  approved  deviations, 
substitutions,  waivers,  and  examples  of  special  circumstances 
that  we  concluded  that  there  was  a  need  for  better 


understanding  of  the  basic  theory  and  application  of  tasting 
in  DOD. 

We  believe  OSD  needs  to  examine  the  services'  criteria 
for  granting  exceptions  to  the  overall  policy  with  a  view 
to  reducing  this  practice. 

OSD  feels  that  the  new  guidelines  set  forth  in  its 
July  1971  DODI  5000.1  on  the  acquisition  of  major  defense 
systems  will  go  far  in  minimizing  p  rob  lens  of  the  past. 

Recommendations 

We  recoaaend  that  the  Secretary  of  Defense  develop  and 
implement  DOD-wide  guidance  to  provide  that  Cl)  appropriate 
testing  and  evaluation  be  completed  prior  to  making  key  deci¬ 
sions  and  (2)  adequate  controls  be  set  over  the  granting  of 
any  waivers  from  required  testing  and  evaluation. 

C0ST-EFFEC3TVESESS  STUDIES 

Cost-effectiveness  studies  are  one  of  the  techniques 
used  in  reaching  decisions  as  to  which  among  several  compet¬ 
ing  weapons  systems  is  store  likely  to  achieve  a  predeter¬ 
mined  mission  goal  at  the  lowest  cost.  The  overall  goal  of 
such  stvjdies  is  to  assist  a  decisionmaker  by  arraying  signi¬ 
ficant  factors  to  help  in  identifying  a  preferred  system 
among  the  alternatives. 

*  *  a 

The  selection  of  the  specific  base  line  for  a  weapon 
acquisition  program  from  the  available  options  must  depend 
on  the  type  of  comparisons  which  the  cost -effectiveness 
techniques  can  provide.  These  axe  essentially  paper  analy¬ 
ses  with  limitations  which  can  be  alleviated  only  as  the 
weapon  progresses  in  definition. 

As  a  result  of  our  review,  we  are  convinced  of  the 
definite  usefulness  of  cost-effectiveness  studies.  Ve  be¬ 
lieve  the  greatest  advantage  of  the  cost-effectiveness  tech¬ 
nique  is  that  it  forces  advocates  of  a  weapon  system  to 
examine  in  depth  factors  to  be  considered  in  making  the  de¬ 
cision  and  that  it  provide.*  the  decisionmaker  with  a  body 
of  knowledge  which  may  otnervise  be  unavailable.  Frca*  what 
we  observed  sound  information  was  not  available  in  a  number 
of  instances. 
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PERFORMANCE  KEASUR BiENT  FOR  SELECTED  ACQUISITIONS 

A  fund  mental  responsibility  of  managers  of  major  weapon 
systems  in  DCD  is  tc  ensure  that,  visibility  of  the  contrac¬ 
tors*  progress  on  their  systems  is  sufficient  to  indicate  the 
reliability  of  results  being  displayed  in  terms  of  estab¬ 
lished  cost,  schedule,  and  performance  milestones.  To 
achieve  this,  program  managers  must  have  management  informa¬ 
tion  and  control  systems  referenced  to  baselines  which  will 
provide  early  identification  of  developing  programs.  One 
vey  to  obtain  this  is  to  compare,  on  a  regular  basis,  the 
actual  cost  of  specific  work  being  performed  with  the  planned 
cost  for  that  same  work.  DOD  iias  been  working  on  this  for 
setae  time,  and  procedures  do  exist  for  measuring  program 
progress. 

Use  of  approved  perfortaar.ee  management  systems  will  not 
prevent  overruns  or  ensure  achievement  of  schedule  or  tech¬ 
nical  goals.  Through  proper  surveillance  by  the  Government, 
such  systems  should  provide  early  identification  of  problems 
related  to  cost  and  progress,  which  should  enable  alternative 
or  corrective  action  in  the  early  phases  of  a  program. 

Technical  performance  measurement  has  been  recognized 
as  a  troublesome  area.  Until  some  way  is  found  to  more 
closely  relate  technical  performance  achievement  to  cost  and 
schedule,  eephasis  should  be  placed  on  ensuring  that  suffi¬ 
cient  critical  technical  milestones  are  included  in  contracts 
and  that  achievement  is  ensured  through  a  comprehensive  test 
and  evaluation  program. 


SYSTEM  COST  EXPERIENCE 

Our  analysis  of  the  estimated  costs  cc  develop  77  major 
weapon  systems  which  are  prepared  at  various  points  in  the 
development  cycle  shows  that  the  current  estimates  through 
program  completion  have  grown  31  percent  in  comparison  to 
the  planning  cost  estimates  fcr  these  programs.  This  is 
down  from  last  year's  40  percent  reported  on  61  systems. 

The  decrease  is  attributed  pri’oarily  to  (1)  the  addition  of 
a  number  of  new  systems  to  our  rev* erf  this  year,  which  has 
reduced  the  program  planning  oase  on  which  the  percentage 
computation  is  made  and  (2)  the  significant  number  of  quan¬ 
tity  decreases  on  many  of  the  77  systems. 

The  latter  point  has  been  of  particular  concern  to  us 
in  our  review  this  year,  along  with  the  other  categories  into 
which  DOD  segregates  its  weapon  systems  cost  growth.  As  re¬ 
ported  last  year,  DOD  instructions  provide  for  classifying 
cost  changes  into  nine  categories  of  cost  variance  and  the 
segregations  being  made  are  useful  in  focusing  attention  on 
areas  where  improvement s  can  be  cade.  An  analysis  cf  fiscal 
year  1971  alone  clearly  shows  the  great  amount  of  cost 
changes  that  took  place.  For  the  46  systems  on  which  in¬ 
formation  vas  available  at  June  30,  1971,  we  found  that  cost 
changes  totaled  $30.8  billion  in  fiscal  year  1971.  About 
$12.2  billion  is  directly  related  to  changes  in  the  quantity 
of  units  to  be  purchased,  and  nearly  all  of  that,  or 
$11.7  billion,  results  from  decreased  units  to  be  bought. 
This,  of  course,  means  the  unit  cost  of  the  remaining  items 
to  be  bought  is  increased.  Not  so  obvious,  however,  but 
perhaps  far  more  significant,  i3  the  impact  of  these  quan¬ 
tity  reductions  on  interrelated  weapon^  programs,  all  of 
which  are  part  of  an  overall  plan. 

This  is  not  to  say  that  cost  growth  or  changes  that  may 
result  in  increase  or  decrease  to  a  system's  totaled  antici¬ 
pated  cost  or  the  reason  for  cost  growth  is  bad.  In  many 
instances  change  Is  desired  and  should  be  implemented  when 
in  the  Government's  interest.  It  does  seem  that  the  con¬ 
stant  fluctuation  in  the  cost  estimates  is  indicative  of 
some  of  the  serious  problems  which  management  is  faced  with 
and  which  are  discussed  in  this  report. 
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SELECTED  ACQUISTICT  REPORTING  SYSTEM 

DOD  is  continuing  to  improve  the  SAR  s  stem.  Our  re¬ 
view  was  directed  at  evaluating  SAR  free  tlu  standpoint  of 
management.  Two  principal  problems  idertifi  d  relate  to 
changing  baselines  for  measuring  progress  anc  credibility 
of  cost  estimates.  A  recurring  problem  is  wh^.„  ve  consider 
to  be  an  unduly  long  delay  in  submitting  SAR  to  top  manage¬ 
ment  through  DCD.  Instructions  require  S to  be  completed 
in  45  days.  More  often  than  not  it  takes  more  than  75  days 
beyond  the  closing  date.  At  June  30,  1971,  there  were  141 
major  weapon  systems  in  the  DOD  inventory;  52  were  reported 
on  SAR.  Ve  believe  visibility  on  the  others  would  be  im¬ 
proved  if  they  also  could  be  included  in  the  SAR  system. 

Reconnmendat  ion 

He  reconmend  that  the  Secretary  of  Defense  reassess  the 
criteria  for  designating  weapon  systems  for  reporting  on  SAR 
in  an  effort  to  expand  the  system. 
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15  KAY  1972 


The  Comptroller  General 

Vj.  ",  Gene  ral  Accounting  Ouice 

441  G  Street,  N.  W. 

ATTN:  Mr.  Hassell  Bell.  Deputy  Director, 

Major  Acquisitions 
Washington,  D.  C.  20548 

Dear  Mr.  Bell: 

In  order  to  expedite  our  response  to  your  draft  report,  "Acquisition  of 
Major  Weapon  Systems,*'  to  be  submitted  to  Congress,  we  are  providing 
comments  in  two  parts.  This  letter  covers  our  cesnxrrents  on  the  Digest 
of  the  report  attached  to  this  letter  as  Enclosure  h  If,  upon  completion 
of  the  review  of  the  entire  report,  we  have  further  substantive  comments 
they  will  be  submitted  to  you  no  later  than  15  May  1^'h 

We  are  pleased  with  your  overall  assessment  thst  since  last  year's  report, 
meaningful  and  measurable  progress  has  been  made  in  the  management  of 
the  acquisition  process.  We  have  carefully  reviewed  the  report  Digest  and 
are  in  general  agreement  with  the  findings,  conclusions  and  recommendations. 
Because  the  report  is  based  largely  on  data  as  of  June  30,  1971  it  does  not 
consider  steps  that  we  have  taken  since  that  date  which  are  responsive  to 
your  recommendations.  We  have  identified  these  and  other  actions  thst 
we  have  taken  and  suggest  that  you  consider  providing  this  letter  to  the 
Congress  with  your  final  report. 

With  regard  to  your  first  recommendation  concerned  With  the  requirements 
planning  process,  we  are  continuing  to  emphasise  Star  development  and  uae 
of  the  Area  Coordinating  Paper  iAGP)  which  was  briefly  described  In  our 
letter  response  to  your  last  year's  report.  In  the  A  CP's  we  establish 
functional  mission  aress  ccrrtt^edsg  to  the  various  fscets  of  military 
operations  and  in  this  framework  the  adequacy  of  specific  related  develop¬ 
ment  programs  is  addressed.  The  ACP  also  iiesofits  mission  deficiencies 
and  capability  duplication  is  the  process  of  formulating  a  general  plan  for 
the  mission  area  that  will  satisfy  the  operational  need.  We  have  found 
that  the  time  and  effort  involved  :*  the  preparation  of  ACF's  is  greater 
than  anticipated;  however,  we  are  confident  of  the  nsefuiness  of  these 
documents  in  our  future  planning  processes.  While  only  four  ACPs  have 
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been  completed  as  of  this  time,  34  more  are  in  preparation.  We  have  also 
taken  steps  to  more  closely  relate  our  mission  areas  and  ACP*  to  the  Joint 
Strategic  Planning  System  of  the  Joint  Chiefs  u  Staff  (JCS>.  All  ACP«  are 
being  reviewed  by  the  JCS.  The  Joint  Strategic  Planning  System  similarly 
has  been  improved  in  that  the  Joint  Research  and  Development  Objectives 
Document  (JRDOD)  now  develops  RiD  objectives  with  indicators  of 
relative  military  importance.  This  revision  adopts  mission*  areas 
similai  to  those  in  OSD  management  documents  which  has  resulted  in  a 
close  relationship  between  JCS  objectives  and  ACFs. 

Most  of  the  defense  systems  designated  as  “major"  in  accordance  with  Do D 
Directive  5000. 1  have  project  managers  assigned.  82  as  of  the  last  count, 
of  which  approximately  25  are  general/flag  rank,  officers.  While  there 
may  be  additional  programs  that  warrant  program  management  organisations, 
we  believe  that  most  of  these  will  be  picked  up  In  the  normal  Defense  Systems 
Acquisition  Review  Council  (DSARC)  review  system.  The  management 
structure  o£  each  major  defense  system  is  presented  at  the  DSARC  reviews 
and  in  some  cases  major  changes  result.  In  the  future  the  project  manager's 
charter  will  be  presented  for  review  at  the  first  DSARC  and  at  later  DSARC's 
if  significant  changes  are  proposed. 

In  the  area  of  improved  cost  estimating  the  Secretary  of  Defense,  in 
December  14*1,  asked  each  of  the  Services  to  make  independent  coet 
estimates,  in  addition  to  other  appropriate  cost  analyses,  on  major 
weapon  systems  at  each  key  decision  point  and  to  make  these  estimates 
available  for  DSARC  reviews.  This  action  was  followed  in  January  1972 
with  the  establishment,  within  OSD,  of  a  Cost  Analysis  Improvement  Group 
(CA1G)  to  review  the  Service  estimates  and  to  develop  uniform  criteria  to 
be  used  by  all  DoD  units  making  such  cost  estimates.  Under  the  C  AlG's 
leadership,  policies  and  procedures  are  also  being  developed  t«  provide 
a  retrievable  and  well-documented  data  base  upas  which  more  accurate 
cost  estimates  can  be  made. 

As  for  the  recommendation  concerning  a  uniform  approach  to  inflation  the 
Assistant  Secretary  of  Defense  (Comptroller)  has  isrued  factors  for  the 
treatment  cf  inflation  throughout  the  DoD  and  the  Selected  Acquisition 
Report  (SAR)  now  also  requires  identification  of  inflation  factors. 

With  regard  to  DoD  guidance  on  testing  the  Secretary  of  Defense  has,  within 
the  past  year,  issued  instructions  designed  to  improve  the  organisation  for. 
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quality  of  and  timeliness  of  n.ccssary  test  and  evaluation.  Continued 
attention  will  be  provided  to  insure  that  programs  are  adapted  to  these 
instructions  to  the  degree  possible  and  as  rapidly  as  possible.  Also, 
further  attention  will  be  given  to  the  matter  of  establishing  increased 
controls  over  the  granting  of  waivers  from  required  testing  and  evaluation. 

As  tor  the  adequacy  of  Selected  Acquisition  Report  coverage  wc  believe 
that  the  criteria  of  DoD  Instruction  7000.3  are  adequate  and  that  the  lack 
of  SAR  coverage  on  any  major  program  is  from  failure  to  implement 
these  criteris.  Most  of  the  newer  programs  have  had  SAR 3  initiated  at 
the  appropriate  time  and  we  will  insure  that  future  defense  systems, 
meeting  the  criteria,  will  have  SAR  coverage. 

We  appreciate  the  opportunity  to  submit  these  comments  and  hope  that  you 
will  find  them  useful. 


*  ' 

Jufejjs. 


Foster,  Jr. 


Enclosure 
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